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1 

Introduction 



This thesis is concerned with investigations into the complexity of term rewriting sys- 
tems. Moreover the majority of the presented work deals with the automation of such 
a complexity analysis. The aim of this introduction is to present the main ideas in an 
easily accessible fashion to make the result presented accessible to the general public. 
Necessarily some technical points are stated in an over-simplified way. I kindly refer the 
knowledgeable reader to the technical summary as presented in Chapter [2J 

Since the advent of programming languages formalisms and tools have been thought 
and developed to express and prove properties of programs. The general goal of the 
here presented work is to develop logical tools for analysing the complexity of programs 
(automatically whenever possible). 

When reasoning about properties of programs, we need to fix the programs, we aim to 
analyse. For a number of reasons this is a difficult choice. On one hand, we would want 
our analysis to be directly transferable into applications, so that we indeed can analyse 
existing software packages without further ado. On the other hand, we want our results 
to be as general as possible, hence our analysis should abstract from individual features 
of programming languages. 

There is no decisive answer to these conflicting priorities, but for me the generality 
of the obtained results appears more important. Successful investigation of abstract 
programs can often be adapted to real-life contexts with ease, while the generalisation of 
tools and methods invented in a specific setting to a more abstract level, may prove to 
be difficult or even impossible. Still it is crucial that the applicability of the introduced 
general concepts is not lost. 

The most abstract formalism we may consider in computer science, are so-called ab- 
stract models of computation. Such abstractions have been intensively studied by math- 
ematicians and logicians at the beginning of the 20 th century. Then the problem was to 
fix a suitable mathematical notion of computation. Several equivalent concepts like com- 
binatory logic, A- calculus, recursive functions, register machines, and Turing machines 
have been put forward by Curry, Church, Godel, Kleene, Turing and others. The central 
computational mechanism of Church's A-calculus is rewriting and bluntly we could argue 
that the A-calculus is simply rewriting in disguise. 

Term rewriting is a conceptually simple, but powerful abstract model of computation. 
Let me describe this computation model in its most abstract and most simple form. 
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We assert a collection of widgets together with rules that govern the replacement of 
one widget by another. For example, if we take the set of states of a computer as our 
collection of widgets and allow the replacement of one state by another, whenever the 
latter is reachable (in some sense) from the first, then this constitutes a term rewrite 
system. A fundamental property of rewrite systems is termination, the non-existence 
of endless rewrite steps, or replacements of one widget by another. Conclusively strong 
techniques have been designed to ensure termination of term rewrite systems. In recent 
years the emphasis shifted towards techniques that automatically verify termination of 
a given term rewrite system. 

Observe that despite its simplicity, rewriting is an abstract computation model that 
is equivalent to all notions of computability mentioned above. For example any OCaml 
program is easily representable as a rewrite system. If this encoding is done carefully 
enough, then termination techniques for rewriting become applicable to show termination 
of programs, sometimes even fully automatically. The use of a functional programming 
language as an example may seem restrictive, as the representation of an OCaml pro- 
gram as a term rewrite system is typically simple. However recent work aims at the 
incorporation of imperative programming languages like Java or C. For example Java 
Bytecode programs become applicable to this setting if a termination graph, represent- 
ing the program flow, is provided in a pre-processing step. The structural information 
of these graphs can then be encoded as term rewrite systems. 

Once we have verified termination of a given term rewrite system, we have (perhaps 
automatically) established a very important property. But in accordance with the legacy 
of rewriting as a computation model, we should strive for more. For a terminating sys- 
tem, we can consider the following problem: Given some widget, how many replacement 
steps can we perform till no more replacement is possible? Termination assert that this 
problem is well-defined. 

This naturally entails investigations into the complexity of term rewrite systems. A 
term rewrite system is considered of higher complexity, if the number of possible rewrite 
steps is larger. In other words the complexity of a rewrite system is measured through 
the maximal possible computation steps possible with this abstract program. 

The investigations into this problem are the topic of my thesis. In line with earlier 
results presented in the literature the study is performed as an analysis of termination 
methods. I.e., instead of directly seeking techniques to establish the complexity of a 
given term rewrite system I have studied the complexity induced by termination meth- 
ods. These investigations cover well-established termination orders as well as modern 
(automatable) termination techniques. 

Through this indirect study, a higher level of understanding is possible. Not only have 
I provided new techniques to analyse the complexity of a given rewrite system, but at 
the same time I have rendered insights into the expressivity of termination methods. 
These results may lead to a new generation of termination provers for term rewrite 
system. Currently a termination prover, if successful, will simply output yes. In the 
future, termination provers can perhaps be identified with complexity analysers: given 
a terminating rewrite system the laconic yes of the prover is replaced by expressive 
information on the complexity of the system. 
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2.1 Status of Research 

As already mentioned in the introduction, term rewriting is a conceptually simple, but 
powerful abstract model of computation. The foundation of rewriting is equational logic 
and term rewrite systems (TRSs for short) are conceivable as sets of directed equations. 

To be a bit more formal, let T denote a finite set of function symbols, i.e., a signature 
and let V denote a countable set of variables. Then the set of terms over T and V 
is denoted as T(J-,V). A TRS TZ is a set of rewrite rules I — > r, where I and r are 
terms. The rewrite relation — ^ is the least binary relation on the set of terms T(J-, V) 
containing TZ such that (i) if s — t and a a substitution, then sa — >^ to holds, and 
(ii) if s —tft t, then for all / € T: /(..., s, . . .) — >n /(..., t, . . .) holds. We sometimes 
write — instead of — if no confusion can arise from this. 

The implicit orientation of equations in rewrite systems naturally gives rise to com- 
putations, where a term is rewritten by successively replacing subterms by equal terms 
until no further reduction is possible. Such a sequence of rewrite steps is also called a 
derivation. Term rewriting forms a Turing complete model of computation, hence funda- 
mental questions as for example termination of a given TRS, are undecidable in general. 
Furthermore term rewriting underlies much of declarative programming. As a special 
form of equational logic it has also found many applications in automated deduction and 
verification. 

In this thesis, I will consider termination problems in term rewriting and the complex- 
ity of term rewrite systems as measured by the maximal length of derivations. 



2.1.1 Termination in Rewriting 



In the area of term rewriting [15l . ll37j ] powerful methods have been introduced to establish 



termination of a given TRS TZ. Earlier research mainly conce ntra ted on inventing suit- 
able reduction orders — for example simplification orders, see 1371 . Chapter 6] — capable 
of proving termination directly. 

As an example let us consider the multiset path order {MPO for short), cf. 4J]. Let 
> denote a strict partial order on the signature T . We call > a precedence. Let s, t be 
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terms. For s, t £ V, we can write s = /(si, . . . , s m ), t = g(ti, . . . , t n ). We define s > m po t 
if one of the following alternatives hold: 

- there exists i £ {1,... , m} such that Sj > mpo t or Sj = i, 

- f > g and s > mpo for all 1 ^ j ' ^ n, or 

- / = g and {si, . . .,s m } >™p {h, . . .,*„}. 

Here >^po denotes the multiset extension of > mpo - 

The definition of MPO entails, that if a TRS TZ is compatible with an MPO > mpo , 
i.e., if TZ C > mpo then termination of 7?. follows. Clearly the reverse direction need not 
hold. Consider the TRS TZi over the signature T = {f, o, e} taken from [7a ]: 

f(x) o(yoz)^xo (f (f (y)) o z) (1) 
f(x) 0(1/0(20 — > x o (z o (y o w)) (2) 
f (s) -» x (3) 

The TRS 7£i is terminating. However we cannot find a precedence > such that TZ± C 
>mpo- This is due to the fact that 7Z\ encodes the Ackermann function as we will see in 
the next section. 

In recent years the emphasis shifted towards transformation techniques like the depen- 
dency p air metho d 0j , its extension the dependency pair framework [138] or semantic 



labe^g The advantage-in particular of the dependency pa^thod-being 



that they are easily automatable. 

Here we briefly recall the basics of the dependency pair method. Below on page 12.2.11 
we will also recall the semantic labeling technique. In the presentation of the depen- 
dency pair method we follow [7(3]. Let t be a term. We set $ := t if t € V, and 
i" := /"(ii, • • • ,t n ) if t = f(t\, . . . ,t n ). Here is a new n-ary function symbol called 
dependency pair symbol. For a signature we define P = T U {ft \ f G T}. The 
set DP (1Z) of dependency pairs of a TRS 1Z is defined as the of pairs i" — > it", where 
1 -> r e K and u is a subterm of r, whose root symbol is a defined function symbol. 
Moreover u is not a proper subterm of I. 

It is not difficult to see that a TRS 1Z is terminating if and only if there exists no 
infinite derivation of the following form 

jj , * A A * 

where for all i > 0, k is terminating with respect to TZ. This is a key observation in the 
formulation of the basic setting of the dependency pair method. We obtain the following 
characterisation of termination due to Arts and Giesl: 

- A TRS TZ is terminating if and only if there exist a reduction pair (>, >-) such that 
DP(n) C >- and TZ C >. 
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Here a reduction pair (•>,>-) consists of a rewrite preorder > and a compatible well- 
founded order y which is closed under substitutions; compatibility means the inclusion 
> • >- • > C K 



Another development is the use of automata techniques to prove termination [54 . 



55l . [98J. Moreover the technique to show termination by building an order-preserving 
mapping into a well-founded domain has received renewed attention 81, 48|, 95]. 

These methods, among others, are used in several recent software tools that aim to 



prove ter minat ion automatically. We mention AProVE 60], CiME 42], Jambox [4 



Matchbox [H3], MU-TERM [1071 ]. TPA T T T 2 joij. In the termination competition 



(a subset of) these provers compete against each other in order to prove termination of 
TRSs automatically, see 



http : //termcomp . uibk . ac . at 



for this ongoing event. 

2.1.2 Complexity of Rewrite Systems 

In order to assess the complexity of a TRS it is natural to look at the maximal length 
of derivation sequences, a program that has already been suggested in 79]. See also 35] 
for a complementary study of the complexity of term rewrite systems. 

The derivational complexity function with respect to a (terminating) TRS TZ relates 
the length of a longest derivation sequence to the size of the initial term. Observe that 
the derivational complexity function is conceivable as a measure of proof complexity. 
Suppose an equational theory is representable as a convergent (i.e., a confluent and 
terminating) TRS, then rewriting to normal form induces an effective procedure to decide 
whether two terms are equal over a given equational theory. Thus the derivational 
complexity with respect to a convergent TRS amounts to the proof complexity of this 
proof of identity. 

In order to make further discussion more concrete, we present the central definitions. 
Let TZ denote a finitely branching and terminating TRSs. The derivation length function 
dl(i, —*) of a term t with respect to a rewrite relation — > is defined as 

dl(i, ->) = max{n j 3 (to, . • • , t n ) : t = t -> h — ► ► t n } 

To make the notion of derivation length independent of the choice of t one defines the 
derivational complexity function (with respect to TZ): 

dc^(n) = max({dl(t, | |t| < n}) , 

where ]•] denotes a suitable term-complexity measure of t, e.g. the number of symbols 
in t. Observe that even for terminating and finitely branching TRS TZ, the induced 
derivational complexity function dc-jz is only well-defined, if either the signature T is 
finite or TZ is finite. Hofbauer and Lautemann [T9fl showed that for finite TRS 



a termination proof by polynomial interpretations implies a double-exponential 
upper bound on the derivational complexity. 
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With respect to syntactically defined termination orders, Hofbauer [76I . [77j established 
that for finite TRSs 

- a termination proof via the multiset path order implies that there is a primitive 
recursive bound on the derivational complexity. 

It is this result that explains why we cannot find a multiset path order compatible with 
the TRS IZi ; recall that this TRS essentially encodes the Ackermann function, which in 
turn implies t hat it s derivational com plexity is at least the Ackermann function. 
Weiermann 145 ]. and Lepper 1031 ] established that for finite TRSs 



- a termination proof via the lexicographic path order (LPO for short) induces a 
multiple recursive bound on the derivational complexity, and 

- if termination is shown by the Knuth-Bendix order (KBO for short), then the 
derivational complexity function is a member of Ack(O(n),0), where Ack denotes 
the binary Ackermann function. 

In all mentioned cases the upper bounds are optimal, i.e., it is possible to provide TRSs, 
whose derivational complexity function form a tight lower bound on the established 
upper bounds. 

For a specific TRS 1Z the mentioned results yield precise upper bounds on the deriva- 
tional complexity of 7Z, i.e., depending on 1Z, one can compute exact upper bounds. 
Therefore, these results constitute an a priori complexity analysis of TRSs provably 
terminating by polynomial interpretations, MPOs, LPOs, or KBOs. As term rewriting 
forms the basis of declarative programming, such complexity results transcend naturally 
to (worst-case) complexity results on declarative programs. 

It is well-known that all mentioned termination methods are incomparable in the sense 
that there exist TRSs whose termination can be shown by one of the these techniques, 
but not by any of the other. Still it is a deep and interesting question, how to characterise 
the strength of termination methods in the large. Dershowitz and Okada argued that the 
order type of the employed reduction order would constitute a suitable uniform measure, 



cf . 47| • Clearly the complexity induced by a termination method ser ves equally well (or 
perhaps better) as such a measure, cf. H . See @, y , 0, H Ei} for further reading 
on this subject. 

In the remainder of this thesis I refer to investigations on (derivational) complexities 
of TRSs as complexity analysis of term rewrite systems. 

To conclude this section, let me apply Lepper's result to the motivating TRS 1Z. 
I kindly refer the reader to Chapter [5] for a formal definition of KBO. Consider the 
precedence > defined by f > o > e together with the weight function w(f) = w(o) = 
and w(e) = 1. Let >kbo be the KBO induced by > and w. Then for all rules I — > r £ TZ, 
I >kbo r - As 7?. is compatible with >kbo> we infer that the derivational complexity of 1Z 
is bounded from above by the Ackermann function. Moreover this upper bound is tight, 



cf. [761 ] . Hence we conclude that the derivational complexity function dc^ 1 features the 



same growth rate as the Ackermann function. 
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2.1.3 Proof-Theoretic Analysis of Complexity Analysis 

Th e study o f the length of derivations of TRSs has stirred some attention in proof theory, 
cf. [l44L I3CL IH. IHoft . This proof-theoretic interest in termination proofs and their induced 



complexity is not surprising. After all, the conceptual theme here is an old theme of 
proof theory. We can suit a conception question dedicated to Kreisel to the present 
context and ask: 

What more do we know from a termination proof, than the mere fact of 
termination? 

While Hofbauer, Weiermann, and Lepper gave answers to this question for specific in- 
stances of termination proofs it was Buchholz who delivered a direct proof-theoretic 
analysis. In order to explain this result, we need a few definitions. 

As usual Peano Arithmetic refers to the first-order axiomatisation of number theory 
and /Si is the fragment of Peano Arithmetic, where the axiom of mathematical induction 
is restricted to existential induction formulas. The fragment /Si is relatively weak, but 
strong enough to prove the totality of primitive recursive functions. 

Let /: N — > N be a function on the naturals and let r f(x) = y n denote a suitable 
chosen computation predicate for the function /. Then / is called provably recursive 
(in the theory T) if T h Vx3y r f(x) = y n holds, i.e., the totality of / is provable in T. 
Note that the provably recursive functions of the theory ISi are exactly the primitive 
recursive functions. Let >- denote a simplification order like MPO, LPO, or KBO and 
let W denote the accessible part of y on T(JT, V), i.e., 

W = Q{A C T{F, V) I Vt(Vs(s ^^s€l)^t6l). 



Then well-foundedness of >~ can be shown using (second-order) induction over W (see 30] 
but also [s^]). In proof one uses the axioms (f) : Vi(Vs(s -< t — > s G X) *-* t G W) and 
(t) : Vt G W(\/s{s ~< t -» F(s)) -» F(t)) -> Vt G WF(t), together with the definition of 

Based on this well-foundedness proof, Buchholz observes that Hofbauer's result is a 
consequence of the following meta-theorem, cf. (3o| . 

- If >- is a primitive recursive relation on T(J-, V) such that ISi h r s y t" 1 — > 
r s >mpo i n and W is a Si-set such that /Ei proves axioms (f) and (X) for all 
Si-formulas, then well-foundedness of y is ISi-provable. 

To see this, Buchholz defines finite approximations y^ of >~ so that the assertions of the 
meta-theorem are fulfilled. Furthermore he proves that compatibility of a TRS 1Z with 
> mpo implies that 7Z C y k for some k depending only on 1Z. Conclusively the meta- 
theorem asserts that well-foundedness of y k is provable in JSi. Hence the derivational 
complexity function dc-^. is contained in the class of provably recursive functions of JEi. 
And thus the derivational complexity function dc-^. is primitive recursive. 

The definition of these approximations is surprisingly simple: It suffices to guarantee 
that y k fulfils the definition of MPO above and additionally s y k t implies \s\ + k 
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cf. [30(]. A similar argument works for LPO, i.e., Hofbauer's and Weiermann's result 
can both be obtained directly by a proof-theoretic analysis. It is worthy of note that 
Buchholz's proof is more general than the combinatorial arguments of Hofbauer and 
Weiermann. First observe that in any case, we can not d ispense the assumption that the 



set {\r\ | I — > r £ TZ} is bounded. However in 771. 1 1441 ] interpretations into the natural 



number are employed that crucially rest on the cardinality of T and the maximal arity 



of the symbols in T ' . In contrast to this 30(] makes only use of the finiteness of the 
signature. 

Observe that a proof-theoretical analysis of KBO along this lines is not possible. 
Although well-foundedness of finite approximations of KBO are formalisable in Peano 
Arithmetic, the needed fragment is too strong to provide an optimal complexity analysis. 
On the other hand proof theory can be used successfully to extend Lepper's result (see 
Chapter Hj). 

The connection of rewriting and proof theory is also addressed in (see also Chap- 
ter [3]) where Cichon emphasises a connection between the order type of a given reduction 
order >~ and the induced derivational complexity. More precisely, the so-called Cichon's 
principle can be formulated as follows. 

The (worst-case) complexity of a rewrite system for which termination is 
provable using a reduction order of order type a is eventually dominated by 
a function from the slow- growing hierarchy along a. 

Here the slow- growing hierarchy denotes a hierarchy of number theoretic functions G a , 
indexed by transfinite ordinals a, whose growth rate is relatively slow: for example 
G(j(x) = x + 1, where u denotes the first limit ordinal. This function hierarchy is 
sometimes called point-wise in the literature, cf. jfjij. See (32! . Chapter 3] for further 
reading. 

It ought to be stressed that this principle is false in general. According to Cichon's 
principle, for any simply terminating TRS TZ, the deri vatio nal complexity function den 



sh ould be majorised by a multiple-recursive function 1251 ] . This however, is not true. 



In [Hi] Touzet introduced a rewrite system TZ coding a restrained version of the (stan- 



dard) Hydra Battle [92| such that no multiple-recursive function can majorise the deriva- 
tional complexity function. Furthermore, TZ is simply terminating. 

Thus the principle fails even for simply terminating rewrite systems. Motivated by 
these negative results Touzet asserts that the Hardy hierarchy, a hierarchy of rather fast 
growing functions, index by ordinals is the right tool to connect the orde r typ e and 



derivation lengths. This point is enforced by later results due to Lepper, cf. 101 

However, note that Cichon's principle is correct for two instances of simplification 
orders mentioned above: MPO and LPO. Es sent ially this follows from the mentioned 



results by Hofbauer and Weiermann, cf. 77], 1 1441 ] . Buchholz's proof-theoretic analysis 



provides some explanation. Namely for TZ compatible with MPO, or LPO, the termina- 
tion proof does not make full use of the order type of (the class of) MPOs or LPOs, but 
only in a point-wise way. Note that the termination proof can even be formalised in a 
provability relation that makes use of ordinals only in a point-wise way (see Arai 0] for 
a more precise account of this connection). 
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Let me conclude this section by mentioning that Cichon's principle underlies the 
open problem # 23 in the list of open problems in rewriting (RTALooP for short, 
see htt p: //rtaloop.mancoosi .univ-paris-diderot .f r/p . 

Must any termination order used for proving termination of the Battle of 
Hydra and Hercules-system have the Howard ordinal as its order type? 



In lid ] (see also [if]]) I resolve this problem by answering it in the negative. 



2.2 Research Program 

The goal of my research is to make complexity analysis of term rewrite systems: 

modern - by studying the complexities induced by modern termination techniques, 

useful - by establishing refinements of existing termination techniques guaranteeing 
that the induced complexity is bounded by functions of low computational 
complexity, for example polytime computable function, 

broad - by analysing the complexities of higher-order rewrite systems and for TRSs 
based on particular rewrite strategies. 

Further I want to ensure that the results that are developed in these three areas provide 
computable and precise bounds. To this avail I am working (together with Avanzini 
and Schnabl) on a software tool: the Tyrolean Complexity Tool (TqV for short) that 
incorporates the most powerful techniques to analyse the complexity of rewrite systems 
that are currently at hand. 

In order to test the competitive capability of TqV, a specialised category for complex- 
ity analysers has been integrated into the international termination competition; see 
http : / /termcomp . uibk . ac . at| or Section [2.61 for further details. 

2.2.1 Modern Termination Techniques 

Modern termination provers rarely employ base orders as those mentioned above directly. 
To the contrary almost all modern termination provers use variants of the dependency 
pair method to prove termination. Hence, we cannot easily combine the result of a 
modern termination prover and the above results to get insights on the complexity of a 
given terminating TRS 7Z. 

To improve the situation, I investigated modern termination techniques, as are usu- 
ally employed in termination provers, in particular I studied the complexities induced 
by the dependency pair method, cf. Section 12.3.11 As indicated below, a complexity 
analysis based on the depe ndency pair method is and (in its full generality) remains a 



challenging task. See 1181 ] for recent developments in the complexity analysis of this 



The Howard-Bachmann ordinal is the proof theoretic ordinal of the arithmetical theory of one inductive 
definition, see [3^ . Chapter 3]. Note that the Howard-Bachmann ordinal easily dwarfs the proof- 
theoretical ordinal of Peano Arithmetic eo. 
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technique. However, if we can obtain optimal complexity analysis results induced by 
modern techniques, we can significantly extend the expressivity of termination provers 
in general. 

Consider a sorting algorithm P like insertion sort and its implementation in a func- 
tional programming language like OCaml: 

let rec insert x = function 

I [] -> [x] 

I y : : ys -> if x <= y then x : : y : : ys 
else y : : insert x ys ; ; 

let rec sort = function 

I □ -> □ 

I x : : xs -> insert x (sort xs) ; ; 

It is not difficult to translate this program into a TRS 1Z, such that termination of 7Z 
implies termination of P. With ease, termination of 7Z can be verified automatically. If 
we can extend automatic termination proofs by expressive certificates on the complexity 
of 1Z, we obtain an automatic complexity analysis on P. I.e., the prover gives us in 
addition to the assertion that 1Z is terminating, an upper bound on the complexity of 1Z 
(and therefore of P). 

Of course this goal requires theoretical and practical work: Firstly deep theoreti- 
cal considerations on the complexity induced by modern termination techniques are 
necessary and secondly modern termination provers have to be extended suitably to 
render the sought certificates automatically. Finally the complexity preservation of the 
transformation from the program P into the TRS 1Z has to be established. Adapting 
transformation techniques as mentioned in the Introduction, it seems possible to extend 
this approach to imp erative programming languages like Java or C without too much 



difficulties. See 124l . |52{ ] for current work on the termination analysis of imperative 
programs via rewriting. 

In the following I discuss the challenges of this endeavour for the key examples of 
the dependency pair method and semantic labeling. In particular a complete analysis 
of the former is of utmost importance as this technique has extended the termination 
proving power of automatic tools significantly. To clarify my point, I briefly state the 
central observations and apply the dependency pair method to the example given in the 
introduction. For further information on the concepts and definitions employed, I kindly 
refer the reader to 0, 70]; further refinements can be found e.g. in 72, 61]. 



- A TRS 1Z is terminating if and only if for every cycle C in the dependency graph 
DG(7£) there are no C-minimal rewrite sequences. 

- If there exists an argument filtering tt and a reduction pair (>, >) so that 
^{TZ) ^ <^ k(C) C > U >, and vr(C) PI > ^ 0, then there are no C-minimal 
rewrite sequences. 

Note that this result is a refinement of the characterisation of termination mentioned on 
page H] above. The dependency graph DG(7£) essentially plays the role of a call graph in 
program analysis. 
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Efficient implementations of the dependency pair method consider maximal cycles 
instead of cycles H Moreover the stated criteria are applied recursively, by disregarding 
dependency pairs that are already strictly decreasing, cf. [7(j. Consider the TRS 7Z\, 
defined on pagelU In the first step the rules (l)-(3) are extended by the TRS DP(7^i): 





f(x) o" (y o z) - 


-> X o» (f(f (y)) z) 


(4) 




f (x) o" (y o z) - 


-»f(%))o*i/ 


(5) 




f(x) o" (y o z) - 


->f»(f(y)) 


(6) 




f (x) o" (y o z) - 


-f«(y) 


(7) 


f(x) 


o" (j/o(zo u>)) - 


-> X 0" (z (y 


(8) 


f(x) 


o" (j/o(zo id)) - 


-> Z 0" (y w) 


(9) 


f(x) 


o" (y o (z o w)) - 




(10) 



The next step is to compute an approximated dependency graph for DP(7^i), presented 
in Figure [2XU 

This graph contains only one maximal cycle comprising the rules {4,5,8,9,10}. By 
taking the polynomial interpretation f^(x) = x and o N (x,y) = o^(x,y) = x + y + 1 the 
rules in {1 — 4, 8} are weakly decreasing and the rules in {5, 9, 10} are strictly decreasing. 
The remaining maximal cycle {4,8} is handled by the subterm criterion [72|. 

This simple example should clarify the challenge of the dependency pair method in 
the context of complexity analysis. Recall that the TRS 1Z\ (essentially) represents the 
binary Ackermann function. Hence the complexity cannot be bounded by a primitive 
recursive function. However, the only information we can directly gather from the given 

2 In the literature maximal cycles are sometimes called strongly connected components. We use this 
notion in its original graph-theoretic definitions later on, see Chapter [9] Hence I refrain from following 
this convention. 
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proof is the use of polynomial interpretations and the subterm criterion. Neither of these 
methods is individually — i.e., as a basic termination technique — of sufficient strength to 
yield an upper bound on the complexity of TZ. 



Semantic Labeling 

Similar to the dependency pair method, semantic labeling is a transformation technique. 
Its central idea is to employ semantic information on the given TRS TZ to transform TZ 
into a labeled TRS TZ\ a ^ such that TZ is terminating if TZ\ a b is terminating. The obtained 
annotated TRS is typically larger and may even be infinite, but the structure may get 
simpler. If this is indeed the case then TRSs whose termination proof is challenging can 
be handled with relatively simple methods. 

Let A be a model of the TRS TZ. A labeling I for A consists of a set of labels Lj 
together with mappings if: A n — > Lj for every / G / n-ary, where A is the domain 
of the model A. For every assignment a: V — > A, let lab a denote a mapping from terms 
to terms defined as follows: 



lab Q (t) := 



t if t £ V , 

/(laba(ti), . . . ,lab (t n )) if t = f(h, . . . ,t n ) and L f = 
,/a(lab Q (ii), . . . , \ab a (t n )) otherwise . 



The label a in the last case is defined as £f([oi\j\ti, . . . , [a]^t n ), where \a\j\t denotes the 
evaluation of term t with respect to the model A and the assignment a. The labeled 
TRS TZ\ab is defined as 

{\ab a (l) — > lab a (r) | I — > r £ TZ and a an assignment} . 

Below I st ate the centra l result for one variant of semantic labeling, for further refine- 
ments see 



14flL fiiol . H S,[n|. 



- Let TZ be a TRS, A a model for TZ, and I a labeling for A. Then TZ is terminating 
if and only if the labelled TRS TZ^ (with respect to £) is terminating. 

Note that the model A of the TRS TZ is used to represent the semantic information of 
TZ. 

Semantic labeling turns out to be a promising candidate for complexity analysis. It 
is not difficult to see that the derivation length of each term with respect to TZ equals 
its derivation length with respect to TZ\ 3 b. Therefore results on the complexity of TZ\ a b 
are transferable to the original system. The latter remains true, if refinements of the 
semantic labeling technique are used. 

Still there is plenty of room for research, as often the transformed system TZ\ a b is 
infinite. However, the mentioned results on derivational complexities in Section [2.1.21 do 
not necessarily carry over to infinite TRSs. Indeed in the case of a TRS compatible with 
either MPO or LPO it is easily verified that the results become false for any computable 
upper bound, cf. Section 12.3.11 
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Modern Direct Termination Techniques 

Let me briefly mention known results on the complexities of modern termination tech- 



niques that we have not yet treated. First, we consider the match-bound technique [54l.l56l| 



a new method for automatically proving termination of left-linear term rewriting sys- 



tems. In 56] linear derivational complexity for linear match-bounded TRSs is estab- 
lished, but exponential lower bounds exist for top-bounded TRSs. This result extends 
to non-linear, but non-duplicating TRSs. For non-left-linear (non-duplicating) TRSs, 
the notion of match-boundedness has to be replace d by match-raise-boundedness. The 



latter technique is introduced in [98j]. Employing [8CJ, |98|] it is not difficult to argue 
that any non-duplicating, right-linear, and match-raise bounded TRS induces at most 
linear derivational complexity. In the context of derivational complexity analysis the 
restriction to non-duplicating TRSs is harmless, as any duplicating TRS induces at least 
exponential derivational complexity, see Section 12.31 for further details. 



Secondly, consider the matrix interpretation method [8ll. l48l]. In general the existence 
of a matrix interpretation for a given TRS 1Z induces exponential upper bounds on the 
derivational complexity function dc^. However, two specific instances of the matrix 
interpretation method have recently been studied in the literature: the arctic matrix 
method and triangular matrices. 

The arctic matrix method employs matrices over the arctic semi-ring that employs 
as domain the set N U {— oo} together with the operations maximisation and addition. 



sec 



95], This technique induces linear derivational complexity for string rewrite systemsj 
if employed as a direct termination technique, cf. [hH]. On the other hand, triangular 
matrix interpretations restrict the form of matrices (defined over the n atural numbers N 
together with the usual operations) to upper triangular form. In 120l ] we establish that 



the induced derivational complexity is polynomial, where the degree of the polynomial 
is the dimension of the employed matrices. 



2.2.2 Low-Complexity Bounding Functions 

The greatest hindrance in exploiting the majority of results on derivational complexities 
is the fact that the obtained upper bounds for general TRS are only of theoretical value. 
Even the smallest bound, i.e., the double-exponential bound, mentioned in Section [2.1.21 
cannot be considered computationally feasible. Note that, while this upper bound is 
tight for the class of polynomially terminating TRSs, it is not difficult to find polynomi- 
ally terminating TRSs whose derivational complexity functions grow much slower than 
double-exponentially. In the same spirit we easily find TRSs compatible with MPO, 
LPO, or KBO, respectively that do not exhibit the theoretical upper bound on the 
derivational complexity presented in Section [2.1.21 

With respect to polynomial interpretations, this observation led for example to the 
development of context-dependent interpretations, that allow a finer analysis of the 
derivational complexity [78| and with respect to LPO-termination this leads to a re- 
fined analysis of the above mentioned result that LPO induces multiple recursive upper 

3 String rewrite systems are a specific class of TRSs, such that all function symbols have unary arity. 
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bounds, cf. [6(. Therefore, one would want a more careful calibration of the results 
mentioned in Section 12,1.21 so that the analysis of complexities of TRSs becomes more 
versatile. Below I will take this further by striving for bounding functions on the com- 
plexity that are feasible, or at least belong to one of the lower classes in the polynomial 
hierarchy. 

This is a non-trivial task: Even in the case of linear termination, where we restrict the 
interpretation functions to linear polynomials, the derivational complexity is optimally 
bounded by an exponential function, cf. [7^ ]. Moreover, although we can characterise the 
class of polytime computable functions (FP for short) by carefully controlling the way the 
successor symbols are interpreted, feasible upper bounds on the derivation length requires 



new ideas, see for example [37|, |26|, [78| but also [8(] (Chapter [4]) and [HI] (Chapter [6]) . 

The quest for low-complexity bounding functions highlights a shortcoming of the tra- 
ditional notion of derivational complexity that I will discuss now. While the derivational 
complexity function dc-ji is well-motivated if we are mainly concerned with the strength 
of (direct) termination techniques (see 79, 7^, 3(3, 7g|]), its usability becomes more ques- 



tionable in the wider perspective we take here. 

Consider a TRS TZ, encoding a functional program P. Then the applicability of our 
results in program analysis hinges on the fact that results on the complexity of TZ are 
meaningful measures of the (runtime-)complexity of the program P. For example, con- 
sider the version of insertion sort introduced in Section [2.2.11 Typically, we will not call 
the function sort iteratively, but sort will be given values as arguments. Consequently 
we are only interested in the runtime complexity of such a function call, but the above 
given definition of derivational complexity may overestimate this complexity. In par- 
ticular, the following example indicates that the derivational complexity function may 
overestimate the "real" complexity of a computed function for purely syntactic reasons. 
Consider the TRS TZ 2 

is_empty(nil) — > T 
is_empty(x::?/) — > _L 
\r\d(x::y) — > x 
t\(x::y) -> y 

append(x, y) — > ifappend(x, y, x) (*) 
ifappend(x, y, u::v) —> u::append(f , y) . 

Although the functions computed by TZ 2 are obviously feasible this is not reflected in the 
derivational complexity of TZ. Consider rule (*), which I abbreviate as C[x] — > D[x,x]. 
Since the maximal derivation length starting with C n [x] equals 2 n_1 for all n > 0, 
TZ admits (at least) exponential derivational complexity. A possible solution how to 
overcome this obstacle, is discussed in Section [2~3l below. 



2.2.3 Strategies and Higher-Order Rewriting 

Reduction strategies in rewriting and programming have attracted increasing attention 
within the last years. New types of reduction strategies have been invented and investi- 
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gated, and new results on rewriting under particular strategies have b een o btained. 

To be precise, I recall the central definitions, for further details see 1371 . Chapter 9]. 
A rewrite strategy for a TRS is a mapping S that assigns to every term s not in normal 
form a non-empty set of finite non-empty derivations starting from s. We say that s 
rewrites under the strategy <S to the term t, if s — >^ t € S(t). Typically strategies are 
defined by selecting the redexes which are to be contracted in each step. Examples of 
such strategies are the leftmost outermost rewrite strategy, where always the leftmost 
outermost redex is selected. Likewise, the leftmost innermost strategy contracts the left- 
most of the innermost redexes. Other examples of strategies are the parallel innermost, 
parallel outermost, the full substitution and the call-by-need strategy. 

Strategies allow us to efficiently compute normal forms of weakly normalising rewrite 
systems. Thus considering complexities for TRSs governed by rewrite strategies im- 
mediately broadens the applicability of complexity investigations. The more pressing 
reason, why we want to investigate strategies is that rewrite strategies allow far more 
efficient computations of normal forms. Through strategies the best-case behaviour of 
a termination method, described as the shortest derivation length, becomes accessible. 
Hence, considering strategies appears to be one step forward to obtain feasible upper 
bounds on the complexities of rewrite systems. 

Reduction strategies in rewriting are one way to broaden the applicability of complex- 
ity results. Another extension stems more directly from programming. Consider the 
following OCaml program P encoding the definition of the higher-order function map: 

let rec map f 1 = function 
I [] -> [] 

I hd : : tl -> f hd : : map f tl; ; 

Highe r-ord er programs like P can either be represented as S-expression rewrite sys- 
tems 141 . 1 14211 or as applicative systems, employing a binary applicative symbol o, 
cf . 9l|, Ill4l . l59l ] . While .^-expression rewrite systems and in particular applicative systems 
have been studied extensively, relative little effort has been spent to prove termination 
of higher-order rewrite systems directly, see 

Currently the complexity analysis of higher-order systems via rewriting has not yet 
attracted much attention. Although there is long established interest in the functional 
programming communit y to automatically verify complexity properties of programs, see 
for example no results along the lines presented here can be found 

in the literature. Future research will overcome this restriction as the applicability of 
complexity analysis to rewrite systems in the context of (functional) programs is of 
utmost importance to the sustainability of this research, see Section 



2.3 Contributions 

Above I define the derivation length function dl(i, — >) of term t with respect to a rewrite 
relation — > as the longest possible derivation (with respect to — >) starting with t. Based 
on the derivation length, Hofbauer and Lautemann defined the derivational complexity 
function den with respect to the (full) rewrite relation — Instead I propose the 
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following generalisation of this concept to arbitrary relations. Additionally this concept 
allows for better control on the set of admitted start terms of a given computation. Let 
1Z be a TRS and T C T(JF, V) be a set of terms. The runtime complexity function with 
respect to a relation — > on T is defined as follows: 

rc(n, T, ->) = max{dl(t, -*•) | t G T and |i| < n} . (2.1) 

Based on this notion the derivational complexity function becomes definable as follows: 
dc-ji(n) = rc(n, T(J r , V), — >7^). Currently four instances of (12, ip are most prominent in 
research: 

- the derivational complexity function den, as defined above. 

- the innermost derivational complexity function dc^ = rc(n,T(J-,V),-^iz). 

- the runtime complexity function rcn = rc(n, 7b,— >). 

- the innermost runtime complexity function rc^ = rc(n,7b, -^). 

Here -^tj denotes the innermost rewrite relation with respect to 1Z and 7b C T(J-, V) 
denotes the set of constructor-based terms, cf. [3]. A constructor based term directly 
represents a function call with values as argument. Hence this notion corresponds nicely 
to the typical use of runtime complexity in the literature on functional programming, 



cf. [24]]. Note that the runtime complexity of a TRS extends the notion of the cost 
of (constructor based) term as introduced in [3H]. Technically the broader definition 
has the advantage that the syntactic restriction to non-duplicating TRSs mentioned in 
Section [2.2.21 can be overcome. Indeed, as expected, the (innermost) runtime complex- 
ity function rcn 2 of the TRS IZ2 given on page HH is linear, and this can be verified 
automatically, see Chapter [H 

2.3.1 Modern Termination Techniques 

The starting point of my research into the complexity of rewrite systems was an inves- 
tigation of Hofbauer's and Weiermann's results on the derivational complexity induced 
by MPO and LPO, see Section [2.1.21 More precisely, in Chapter [3] a generalised system 
of fundamental sequences is introduced and its associated slow-growing hierarchy is de- 
fined. These notions provide the tools to establish a modernised (and correct) treatment 
of Cichon's principle for the simplification orders MPO and LPO. 

In order to state the central results precisely, I introduce some further definitions 



(see [32j, Chap ter 4 ] for additional background information). Let A denote the small 
Veblen ordinal |l33l ] and let otype(^) denote the order type of a well-founded relation >-. 
It is well-known that A = sup{otype(^) | >- is a lexicographic path order}, cf. [130]. Let 
> denote a precedence on the signature J 7 , let >i po denote the induced LPO and let 
7r : T(JF) — > A denote an interpret ation from the set of ground terms into the ordinals 



less than A. The central results of 119( | (see Chapter [3]) can be paraphrased as follows; 
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• There exists a generalised system of fundamental sequences for ordinals below A 
that allows the definition of a point-wise relation >( x )- Roughly speaking >t x ) 
denotes the descent along the x th branch of these fundamental sequences. 

• If TZ denotes a finite TRS compatible with >i po , then there exists a number k, such 
that for any rule I — ► r £ TZ and any ground substitution p, we have n(lp) 
ir(rp). 

• There exists a slow-growing hierarchy of sub-recursive function Ua<A such that 
if a >( x \ 0, then G a {x) > Gp(x). 

As the hierarchy \J a<A E(G a ) characterises exactly the multiple-recursive functions, we 
re-obtain the above mentioned result that LPO induces multiple-recursive derivational 
complexity. (Here E(f) denotes the elementary closure of function /.) 

In subsequent research I generalised the introduced concepts s uita bly to analyse the 



derivational complexity induced b y th e Knuth-Bendix order (see 1151 ] ) . This substanti- 



ated and clarified claims made in [1191 ] that the provided concepts are genuinely related 
to the classification of the complexity of rewrite systems for which termination is provable 
by a simplification order. In Chapter [5] the derivational complexity of TRSs 1Z compat- 
ible with KBO is studied, where the signature of 1Z may be infinite. It is shown that 
Lepper's result on the derivational complexity with respect to finite TRS is essentially 



preserved, see lid ] (cf. Chapter [5]) for further details. 



• Let 1Z be a TRS based on a signature J- with bounded arities that is compatible 
with a KBO >kbo and let some weak assumption on 1Z be fulfilled. Then for any 
term t: dl(t,-> w ) < Ack(2°( n ), 0), 

where the constant hidden in the big-Oh notation, depends only on syntactic properties 
of the function symbols in t, the TRS 1Z and the instance >kbo used. Note that T need 
not be finite. As a corollary to this result I re-obtain the 2-recursive upper-bound on 
the derivational complexity of finite rewrite systems 7Z compatible with KBO. 

It seems worthy of note that the material presented in Chapter [5] provides the first 
in-depth derivational complexity analysis of semantic labeling. Recall from Section 12.2.11 
that the central idea of semantic labeling is to transform the given TRS 7Z into a system 
72.| a b such that 7Z is terminating if and only if TZ\ a b is terminating. Furthermore showing 
termination of TZ\ a b should be easier than showing termination of TZ. 

As indicated, semantic information (i.e., a model of TZ) is used to define the new 
system TZ\ a b. If this model is finite, then the complexity certificates for TZ\ a b are trivially 
transferable into complexity certificates for TZ. However, often infinite models would be 
more suitable, which changes the picture completely. See l94| for further reading 

on semantic labeling with infinite models. 

The main problem is that classic results on complexities of simplification orders (see 
Section I2.1.2P not necessarily extend to infinite signatures. It is not difficult to see that 
the complexity results on MPO and LPO mentioned in Section f2 . 1 . 2 1 cannot be extended 



to infinite signatures, cf. 1141 ]. On the other hand the above result shows that for KBO, 
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complexity results are transferable, even if the underlying model is infinite. Observe that 
the weak restrictions mentioned, typically hold for systems obtained via the semantic 



labeling transformation, see 1 151 ] or Chapter [5j 

In Section 12.2.11 1 indicated the challenges posed, if we aim for a classification of the 
complexities of TRSs, whose termination is shown by the dependency pai r method. In 



order to tackle these difficulties recent efforts in this direction (see |74l. 1 751]) concentrate 
on estimates for (innermost) runtime complexities. In this context we are most interested 
in techniques that induce polynomial (innermost) runtime complexities. 



In [7J,l75( a variant of the dependency pair method for analysing runtime complexities 
has been introduced (cf. Chapter [8] and [9]). We show how natural improvements of 
the dependency pair method, like usable rules, reduction pairs, argument filterings, and 
dependency graphs become applicable in this context. More precisely, we have established 
a notion of dependency pairs, called weak dependency pairs that are applicable in the 
context of complexity analysis. This notion provides us with the following method to 
analyse runtime complexity: 

• Let 1Z be a TRS, let A be a restricted polynomial interpretation, essentially ex- 
pressing a weight function, let (>, >) denote a reduction pair (not necessarily 
based on A) that fulfils some additional conditions and let V denote the set of 
weak dependency pairs of 1Z such that V is non-duplicating. Suppose the usable 
rules U(V) of V are contained in > and V C >. Moreover, suppose U(V) Q >a- 
Then the runtime complexity function rc-jz with respect to 1Z depends linearly on 
the rank of the order >. 



Here the rank of a well-founded order is defined as usual. Observe that it is very easy 
to verify the mentioned additional restriction on the reduction pair (>,>), if (>, >) is 
based on a polynomial interpretation B, cf. Chapter These results can be adapted 
for the special case of innermost rewriting. Here we replace the full rewrite relation —5-7^. 
in the definition of runtime complexity by the innermost rewriting relation -^n- The 
established techniques are fully automatable and easy to implement. 

Let me reformulate this important result in a slightly more concrete setting. Suppose 
A is defined as above and assume B denotes a polynomial interpretation, fulfilling the 
restriction that constructors are interpreted as weights. Then it is easy to see that if 
a TRS 1Z is compatible with such an interpretation B the runtime complexity of TZ is 
polynomial (see Chapter [8] but also [26j]). As a corollary to the above result we obtain: 

• Let 1Z be a TRS, let V be the set of weak dependency pairs of TZ, and let A 
and B be defined as above. Suppose (^0, >b) forms a reduction pair and in 
addition: U(V) Q and V C > B , where V is supposed to be non-duplicating. 
If U(V) C >_4 then the runtime complexity function rc-ji with respect to TZ is 
polynomial. 

This result significantly extends the analytic power of existing direct methods. Moreover 
this entails the first method to analyse the derivation length induced by the (standard) 
dependency pair method for innermost rewriting, cf. Chapter 
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2.3 Contributions 



2.3.2 Low-Complexity Bounding Functions 

As already observed in Section [2.2.21 it is not difficult to find polynomially terminating 
TRSs, whose derivational complexity functions grow significantly slower than double- 
exponentially. I.e., polynomial interpretations typically overestimate the induced deriva- 



tional complexity. In 78] Hofbauer introduced context-dependent interpretations as a 



remedy. Consequently these interpretation provided a starting point in the analy sis of 



termination methods that induce polynomial derivational complexity. Indeed in 1171 ] 
(see Chapter [7J) such an analysis is conducted and a new method to automatically con- 
clude polynomial (even quadratic) derivational complexity is given such that we obtain 
the following result: 

• Let 7Z be compatible with a specific restriction of a context-dependent interpre- 
tation, called ^.-restricted interpretation. Then dcn(n) = 0(n 2 ). Moreover there 
exists a TRS 1Z such that dcn(n) = Q(n 2 ). 

Moreover, subsequent research revealed the existence of a tight correspondence between 
a subclass of c ontex t-dependent interpretations and restricted triangular matrix inter- 
pretations, cf. 12Cl( |. On the one hand this correspondence allows for a much simpler 



and more powerful method to automatically deduce polynomial derivational complex- 
ity. On the other hand this result reveals a connection between seemingly very different 
termination techniques: matrix interpretations and context-dependent interpretations. 
Moreover this result would not have been observed if we had investigated these tech- 
niques directly and not the induced complexity. (Observe that no indication of this 
correspondence result could be found in the literature.) 

Buchholz's result (described in Section I2.1.3j) suggests another approach. Conceptu- 



ally 30[] provides a new well-foundedness proof of MPO and LPO (by induction on the 
accessible parts of these orders) and miniaturises this proof in the context of termi- 
nation analysis. This entails the idea to directly study miniaturisations of well-known 
reduction orders in such a way that infeasible growth rates are prohibited. Of course 
these miniaturisations have to be done carefully to prevent us from robbing the order 
from any real termination power. 

To this avail we introduce in 0] (see Chapter H]) the path order for FP (POP for 
short). We could show that POP characterises the functions computable in polytime, 
i.e., the complexity class FP. In particular any function in FP is representable as a TRS 
compatible with POP. Moreover, we established the following result: 

• A termination proof for a TRS TZ via POP implies that for any / € T of arity m 
dl(/(S ni (0), . . . , S nm (0)), — >ti) is polynomially bounded in the sum of the (binary) 
length of the input S ni (0), . . . ,S™ m (0). 

Still, in practice, the applicability of POP is limited. Many natural term-rewriting 
representations of polytime computable functions cannot be handled by POP as the im- 
posed restrictions are sometimes not general enough. To remedy this situation I studied 
generalisations of POP that are more broadly applicable. These investigations resulted 
in the definition of a syntactic restriction of MPO, called POP*, and the following result, 
cf. [U (see Chapter ij). 
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2 Summary 



• A termination proof for a TRS TZ via POP* implies that the innermost runtime 
complexity function rc)^ is polynomially bounded. 

Moreover POP* is complete for FP. It should be stressed that as characterisations of 
complexity classes the orders POP and POP* are closely related. However, with respect 
to direct applicability and in particular automatisation the latter result is a lot stronger. 
It is worth noting that our result in depends on the careful combination of the 



miniaturisation of the multiset path order together with a specific strategy. Hence |lll ] 
provides an important indication of the need to consider rewrite strategies in complexity 
analysis, see Section 12.2.31 



2.4 Related Work 

I mention here only work that is not already cited in Sections 12.2. 114272.31 Concerning 
low-complexity bounding functions, I want to mention the connection between the com- 
plexity analysis of a TRS TZ and the computability of TZ. Roughly speaking a function 
/ is computable by a terminating TRS TZ if there are function symbols F, S, P, 0, 0' such 
that 

F(S ni (0),..-,S nm (0)) ->k p/(»i.».,nm)(o') , 



holds for all n\, . . . ,n m , cf. [8J]. The distinction between the input successor S and the 
output successor P, as well as between and 0' is sometimes necessary to allow finer 
distinctions. 

We say a function / is computable with respect to a termination method M, if / 
is computable by a TRS that is M-terminating. For large complexity classes, as for 
example the primitive recursive functions, the derivational complexity induced by a ter- 
mination method implies its computability, cf. [401 ] . For example the class of functions 



computable with respect to MPO equals the primitive recursive functions, cf. 76]. For 
small complexity classes this equivalence is lost. Consider the class of polytime com- 
putable function FP. The class FP is representable as the set of functions computable 
by TRSs TZ that are compatible with restricted polynomial interpretations A, cf. [26| . 
On the other hand, the derivational complexity induced by A is double-exponentially, 
cf. Section EX2J 

This seems to strengthen the argument made above that the derivational complexity 
function dc-ji is not always a suitable measure of the complexity of a TRS. Kindly observe 
that the runtime complexity rc-ji with respect to TZ induced by the interpretations A is 
polynomial. Still, we cannot equate (runtime) complexity and computability in general. 
The fact that a given polytime computable function / is computable by a TRS TZ need 
not imply that rc-ji is indeed polynomial (see 0] but also f\^\). 

The study of the computability of a given function / with respect to a termination 
method as outlined above is clearly connected to the investigations in implicit compu- 
tational complexity theory. In the analysis of the implicit computational complexity of 
programs, one is interested in the analysis of the complexity of a given program rather 
than the study of the complexity of the function computed, or of the problem solved. 
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2.5 Future Research 



Much attention is direction towards the characterisation of "nice" classes of programs 
that define complexity classes in the polynomial hierarchy, most prominently the class 
of polytime computable functions FP. 

In particular I want to mention related work employing term rewriting as abstract 
model of computation and consequently use existing techniques from rewriting to char- 
acterise several computational complexity classes. Interesting techniques in this context 
comprise the mi niatu risation of simplification orders like MPO and LPO, by Cichon and 
Marion, cf. @, fl09j ] . as well as the use of quasi-interpretations or sup-interpretations 
to char acteris e com plexit y classes by Bonfante, Marion, Moyen, Pechoux and others, 

cf. [Titi liR li. [Till. I28LI29I]. 

On a more general level I want to mention add itional work on tier ing or ramification 
concepts by Leivant, Marion, and Pfenning, cf. 101 . IPC . 1021 . 126 ]. Moreover I cite 
Hofmann's semi nal w ork 82l . 83| as well as related results by Aehlig, Schwichtenberg, and 
others, cf. [U. 13. Il34 . TB |. In addition there is highly interesting work on recouc e bounds 
of imperative programs by Niggl, Jones, Kristansen, and others, see [ml . fi2l . Qls^j. 



2.5 Future Research 



In Section 12.2.31 I discussed the general aim to extend existing work on complexity 
analysis for first order rewriting to the higher-order case. As already mentioned one 
way to represent higher-order programs like the map function defined in S ectio n 12.2.31 are 
.S-expression rewrite systems. For clarity, we recall the definition from 14ll . 1 1421 ] . Let 
C be a set of constants, V be a set of variables such that V fl C = 0, and o ^ C U V a 
variadic function symbol. We define the set S(C, V) of S- expressions built from C and V 
as T(C U {o}, V). We write (si • • • s n ) instead of o(s 1; . . . , s n ). An S-expression rewrite 
system (SRS for short) is a TRS with the property that the left- and right-hand sides 
of all rewrite rules are S-expressions. 

Applying transformation steps, like case analysis and rewriting of right-hand sides, 
the function map, as defined in Section 12.2.31 becomes representable as the following 
SRS: 



(map / nil) — » nil 
(map / (cons x xs)) — > (cons (/ x) (map / xs)) 

In recent work together with Avanzini, Hirokawa and Middeldorp (see [lil]) we study 
the runtime complexity of (a subset of) Scheme programs by a translation into SRSs. 
Scheme is a statically scoped and properly tail-recursive dialect of the Lisp prog ramming 
language invented by Guy Lewis Steele Jr. and Gerald Jay Sussman, cf. [135|]. Due to 
its clear and simple semantics Scheme appears as an ideal candidate to apply our results 
on the complexity analysis of TRSs in the context of functional programming. 

By designing the translation to be complexity preserving (or at least closed under 
polynomial functions) the complexity of the initial Scheme program can be estimated 
by analysing the complexity of the resulting SRS. Here we indicate how the above result 
on POP* is applicable to (a subset of) S-expression rewrite systems. 
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2 Summary 



Let S be an SRS over S(C,V) and let C = V U K such that V n K = 0. We call the 
elements of K, constructor constants and the elements of T> defined constants. We define 
the notion of value in the context of SRSs. The set of values Val(«S) of S with respect to 
K is inductively defined as follows: (i) if v G C then v G Val(«S), (ii) if v±, . . . ,v n G Val(<S) 
and c G JC then (c «i . . . u n ) G Val(«S). 

Observe tha t (de fined) constants are values, this reflects that in Scheme procedures 
are values, cf. |l35l ] and allows for a representation of higher-order programs. Scheme 
programs are conceivable as SRSs, allowing conditional if expressions in conjunction with 
an eager, i.e., innermost rewrite strategy. Thus we can delineate a class of SRSs that 
easily accommodates a relative large subset of Scheme programs, called constructor SRSs 



m 



13f | . Based on Toyama's observation that recursive path orders can be successfully 
employed to prove termination of SRSs, we invented an automatic complexity analyser 
for Scheme programs, cf. [la ]. The main theoretical contribution of this work can be 
paraphrased as follows: 

- Let S be a constructor SRS compatible with POP*. Then the innermost runtime 
complexity function rc^ (suitably adapted to constructor SRSs) is polynomially 
bounded. 

In conjunction with the fact that the transformation of Scheme programs into SRS 
is complexity preserving this result provides us with a complexity analysis of Scheme 
programs that is fully automatable. Still, this is only a partial result as the considered 
subset of Scheme programs is only of limited practical interest. In particular we cannot 
yet handle integer values. This will be subject to future research. 



2.6 Conclusion 

In order to assess the complexity of a TRS it is natural to look at the maximal length of 
derivation sequences, a program that has been suggested by Hofbauer and Lautemann 
in 79f] . This concept has given rise to the area of derivational complexity analysis that 
produced a number of deep insights into the strength of direct termination methods, 
described in Section 12.1.21 and 12.1.31 

The goal of my subsequent research was and still is to make the (derivational) com- 
plexity analysis of rewrite systems modern, useful, and broad. For that purpose I have 
analysed the established results in order to assess their appli cabil i ty in the context of 
modern termination provers. These investigations (notably in 119 . 1151 ]) resulted in an 



improved understanding and clarification of the used concepts that often allowed the 
deduction of more general results. 

During this research it became apparent that the "standard" notion of derivational 
complexity with respect to a given TRS was not the right tool to modernise complexity 
analysis. Instead its generalisation to the above introduced runtime complexity function 
with respect to a TRS and a given rewrite strategy proved (up-to now) as the most 
useful. 
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2.6 Conclusion 



Based on this conceptional advance I was able (together with various co-authors) to 
modernise (derivational) complexity analysis to accommodate modern termination tech- 
niques like context-dependent interpretations, match-boun ds, m atrix interpretations, se- 



mantic labeling and dependency pairs, as documented in 1171 . 1 741 . [7 



Moreover, through the research published in 0, 11] the viewpoint of (derivational) 
complexity analysis, is today much more focused on feasible bounding functions than in 
earlier research. This has important consequences for the applicability of this research. 
Earlier investigations were mainly conducted to reveal the strength of termination meth- 
ods, while my research pushed the interest towards the strength or complexity of rewrite 
systems, proper. This opens the door to exciting applications in (automated) program 
analysis. 

Lastly my research in this direction aims at the automation of the introduced tech- 
niques. To this avail I am building (together with Avanzini and Schnabl) the software 
tool TqV to analyse the complexity of rewrite systems automatically. In this context a 
specialised category for complexity analysers has been integrated into the termination 
competition, see 



http : //termcomp . uibk . ac . at 



The goal of this competition is twofold. On one hand the most advanced techniques 
become comparable in a direct contest. Hence different tools compete to provide for each 
system the best possible complexity certificate. For example, if we consider estimation 
of upper bounds, then the tool that provides the tightest bound, gets the highest score. 
On the other hand this competition provides a forum that allows to publicise the gained 
results and insights. A necessity if we want to apply these results outside rewriting. 

I anticipate that the research described here will considerably advance the field of 
term rewriting. Moreover, I anticipate impact on the fields of implicit computational 
complexity theory and proof theory. 

In the context of implicit computational complexity theory (see Section [2.4p my main 
interest lies in studies that employ term rewriting as abstract model of computation and 
consequently use existing techniques from rewriting to characterise several computational 
complexity classes, as described in Section 12.41 Here I highlight the latter approach to 
implicit computational complexity. In Section 12.2.11 we considered a functional program 
P that implements insertion sort. Interestingly P is a challenge for implicit computational 
complexity theory as its obvious polynomial runtime complexity cannot be easily verified. 



This was first observed by Caseiro 33f j . see also [82l. 111]. Observe that program P can be 



easily transformed into the following TRS IZ3: 



if(T,x,y) - 


-> X 


insert(x, nil) - 


-» x::nil 


if (-L, a;, y) - 


-> y 


insert(x, y::z) - 


-> if (a; ^ y,x::y::z,y 


< s(y) - 


-> T 


sort(nil) - 


-» nil 


x < - 




sort(x::z) - 


-* insert(x, sort(z)) 


s(x) < s(y) - 


-> x < y 
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2 Summary 



It is easy to see that IZ3 is MPO-terminating. Moreover, there exists a weakly monotone 
max-polynomial interpretation A such that the interpretation of constructor symbols is 
restricted to weight functions. The induced order weakly orients all rules, cf. Bon- 



fante et al. [29j. Hence TZ% belongs to a specific subclass of rewrite systems studied in 29] 
such that each function computed by such a TRS is polytime computable!! 

In my research I am genuinely interested in "applicable" upper bounds on the com- 
plexities of rewrite systems and therefore I am less concerned with the classification of 
computational complexity classes. Moreover, it seems a not too important statement 
that insertion sort is a polytime computable function. Instead the exciting question is 
whether a given implementation P of insertion sort admits (at most) polynomial runtime 
complexity. We thus have to clarify what exactly we accept as an implementation or 
program. I would argue that in this context term rewriting systems would be a good 
choice and the complexity of P ought to be measured in the natural way for computation 
model. Unfortunately, we cannot conclude polynomial runtime complexity of IZ3 from 
the results by Bonfante et al. (see [2^] but also Chapter [4]). 

Still, there are many connections between complexity analysis of term rewrite systems 
as discussed here and implicit computational complexity theory. For example the use of 
rewriting techniques opens the way for automatisation. Recently, Avanzini, Schnabl and 
myself implemented a fully automated system that incorporates the majority of these 
techniques. See (jjj for the findings of this experimental comparison. 

Furth erm ore derivational complexity studies have stirred some attention in proof the- 
ory, cf . 144 , 130I . 0, [5(3] • Clearly my research has implications for proof theory, see Sec 



tion 12.1.31 Here I want to emphasise that we are implicitly dealing with the connection 
of partial orders and the growth-rate of functions defined by induction on these orders: 
We say that a TRS TZ is a-terminating if TZ is compatible with an ^"-algebra (a, >), 
where > denotes ordinal comparison. Any function computable by an a-terminating TZ 
gives rise to a function defined by transfinite induction up-to a. 

A related connection was first observed by Cichon, who conjectured that the slow- 
growing hierarchies would connect the order type of a termination order compatible 
with TZ with the derivational com plexity of TZ, cf. (3^. Unfortunately, this claim is 



incorrect, as shown by Touzet 1391 ] . On the other hand, the principal connection refers 
to deep proof theoretic questions as for example the "naturalness" of a given ordinal 
notation system, cf. 4^, 20], see also Section 12.1.31 



4 Note that this does not imply that the runtime complexity function rc-n 3 is polynomial, but that the 
function computed is polytime computable (in the usual sense). 
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In this article we introduce the notion of a generalized system of fundamental sequences 
and we define its associated slow-growing hierarchy. We claim that these concepts 
are genuinely related to the classification of the complexity — the derivation length — 
of rewrite systems for which termination is provable by a standard termination ordering. 

To substantiate this claim, we re-obtain multiple recursive bounds on the the deriva- 
tion length for rewrite systems terminating under lexicographic path ordering, originally 
established by the second author. 

3.1 Introduction 

To show termination of a rewrite system R one usually shows that the induced reduction 
relation — is contained in some abstract ordering known to be well-founded. One way 



to assess the strength of such a termination ordering is to calculate its order type, cf. [4 



2003. 




Abstract 




1 http://www.core.edu.au/ 
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3 Relating Derivation Lengths with the Slow-Growing Hierarchy Directly 



There appears to be a subtle relationship between these order types and the complexity 
of the rewrite system R considered. Cichon [3(| discussed (and investigated) whether 
the complexity of a rewrite system for which termination is provable using a termination 
ordering of order type a is eventually dominated by a function from the slow- growing 
hierarchy along a. It turned out that this principle — henceforth referred to as (CP) — is 
valid for the (i) multiset path ordering (^ M po) and the (ii) lexicographic path ordering 

(>"LP0)- 

More precisely, Hofbauer [77| proved that ^ M po as termination ordering implies primi- 
tive recursive derivation length, while the second aut hor sh owed that >- LPO as termination 
ordering implies multiply-recursive derivation length [1441 ] . If one regards the order types 
of >~mpo and ^ LP0 , resp ectively, then these results imply the correctness of (CP) for (i) 
and (ii). Buchholz [301 ] has given an alternative proof of (CP) for (i) and (ii). His proof 
avoids the ( sometimes lengthy) calculations with functions from subrecursive hierarchies 
in [77], 144| . Instead a clever application of proof-theoretic results is used. Although 



this proof is of s triki ng beauty, one might miss the link to term rewriting theory that is 
provided in [77|, Il44 ] . 

The mentioned proofs [77|, [l44|, |30(] of (CP) — with respect to (i) and (ii) — are indirect. 
I.e. without dir ect r eference to t he slow-gr owing; hierarchy. By now, we know from the 
work of Touzet [Hi] and Lepper [l^B that (CP) fails to hold in general. However, 
our interest in (CP) is motivated by our strong belief that there exist reliable ties between 
proof theory and term rewriting theory. Ties which become particularly apparent if one 
studies those termination orderings for which (CP) holds. 

To articulate this belief we give yet another direct proof of (CP) (with respect to (i) 
and (h)). To this avail we introduce the notion of a generalized system of fundamen- 
tal sequences and we define its associated slow-growing hierarchy. These concepts are 
genuinely related to classifying derivation lengths for rewrite systems for which termi- 
nation is proved by a standard termination ordering. To emphasize this let us present 
the general outline of the proof method. 

Let terms s = to, ti, . . . , t n be given, such that s — >r t% — ■ ■ ■ —>r t n holds, where 
t n is in normal form and term-depth of s (t(s)) is < m. Assume —>r is contained in a 
termination ordering >-. Hence s >- t% >- ■ ■ ■ y t n holds. Assume further the sequence 
(s,ti, . . . ,t n ) is chosen so that n is maximal. Then in the realm of classifications of 
derivation lengths one usually defines an interpretation I: T(£,V) — > IN such that 
I(s) > T{t\) > • • • > I(t n ) holds. (T(E, V) denotes the term algebra over the signature 
£ and the set of variables V.) The existence of such an interpretation then directly yields 
a bound on the derivation length. 

The problem with this approach is to guess the right interpretation from the beginning. 
More often than not this is not at all obvious. Therefore we want to generate the 
interpretation function directly from the termination ordering in an intrinsic way. To this 
avail we proceed as follows. We separate I into an ordinal interpretation it: T(£) — > T 
and an ordinal theoretic function g: T — > IN. (T denotes a suitable chosen set of terms 
representing an initial segment of the ordinals, cf. Definition l3.3.1l ) This works smoothly. 
Firstly, we can employ the connection between the termination ordering >- and the 
ordering on the notation system T. This connection was already observed by Dershowitz 
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3.2 The Lexicographic Path Ordering 



and Okada, cf. [471 ] . Secondly, it turns out that g can be denned in terms of the slow- 
growing function G x : T — > IN; x € IN. (Note that we have swapped the usual denotation 
of arguments, see Definition 13.4.21 and Definition 13.6.11 ) 

To simplify the presentation we restrict our attention to a rewrite system R whose 
termination can be shown by a lexicographic path ordering ^ LPO - It will become apparent 
later that the proof presented below is (relative) easily adaptable to the case where the 
rewrite relation -^r is contained in a multiset path ordering ^ M po- We assume the 
signature £ contains at least one constant c. 

Let R be a rewrite system over T(S, V) such that — >r is contained in a lexicographic 
path ordering. Let terms s = to,ti, . . . ,t n be given, such that s ^r t\ — >r ■ ■ ■ -^r t n 
holds, where t n is in normal form and r(s) < m. By our choice of R this implies 

S >~LPO tl >~LPO " " " ^LPO tn • (3-1) 

We define a ground substitution p: p(x) = c, for all x G V. Let > denote a suitable 
defined (well-founded) ordering relation on the ordinal notation system T. Let l,r E 
T(S, V). Depending on m and properties of R, we show the existence of a natural number 
h such that I y LP0 r implies n(lp) > 7r(rp) and Gfi(ir(lp)) > G^(7r(rp)), respectively. 
Employing this form of an Interpretation Theorem we conclude from (13. ip for some 
a 6 T 

a > n(sp) > vr(tip) > • • • > n(t n p) . 

and consequently 

G h (a) > G h (7r(sp)) > G fc (7r(tip)) > • • • > G h (ir(t n p)) . 

Thus G^(a) calculates an upper bound for n. Therefore the complexity of R can be 
measured in terms of the slow- growing hierarchy along the order type of T. 

To see that this method calculates an optimal bound, it remains to relate the function 
G x : T — > IN to the multiply-recursive functions. We employ Girard's Hierarchy Com- 



parison Theorem [64]]. Due to (a variant) of this theorem any multiple-recursive function 
can be majorized by functions from the slow- growing hierarchy and vice versa 1 (For 
further details see Section l3~4"l ) 

Contrary to the original proof in 144j , we can thus circumvent technical calculations 



with the .F-hierarchy (the fast-growing hierarchy) and can shed light on the way the slow- 
growing hierarchy relates the order type of the termination ordering >- to the bound on 
the length of reduction sequences along — >r. 



3.2 The Lexicographic Path Ordering 

We assume familiarity with the basic concepts of term rewriting. However, we fix some 
notations. Let S = {/i, . . . , fx} denote a finite signature such that any function symbol 
/ G S has a unique arity, denoted as ar(/). The cardinality K is assumed to be fixed in 

2 A fc-ary function g is said to be majorized by a unary function / if there exists a number n < lu such 
that g(xi, . . . , Xk) < /(max{a;i, . . . , x^}), whenever max{ii, . . . , Xk} > n. 
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3 Relating Derivation Lengths with the Slow-Growing Hierarchy Directly 



the sequel. To avoid trivialities we demand that E is non-empty and contains at least 
one constant, i.e. a function symbol of arity 0. We set N : = max{ar(/) : / G E}. 

The set of terms over E and the countably infinite set of variables V is denoted 
as T(E,V). We will use the meta-symbols l,r, s,t,u, . . . to denote terms. The set of 
variables occurring in a term t is denoted as var(i). A term t is called ground or closed 
if var(t) = 0. The set of ground terms over E is denoted as T(E). If no confusion can 
arise, the reference to the signature E and the set of variables V is dropped. With t(s) 
we denote the term depth of s, defined as t(s) := 0, if s G V or s G S and otherwise 
t(/(si, . . . , s m )) := max{r(sj) : 1 < i < m} + 1. A substitution a: V —* T is a mapping 
from the set of variables to the set of terms. The application of a substitution a to a 
term t is (usually) written as to instead of o~(t). 

A term rewriting system (or rewrite system) R over T is a finite set of rewrite rules 
(/, r). The rewrite relation — >r on T is the least binary relation on T containing R such 
that (i) if s — t and a a substitution, then sa — to holds, and (ii) if s —*r t, then 
/(..., s, .. .) /(...,£,...). A rewrite system i? is terminating if there is no infinite 
sequence (£j : « G IN) of terms such that ii — t2 • • • t m -^r ■ ■ ■ . Let >- denote 
a total order on E such that >- fa j > i for i,j G {!,... , K\. The lexicographic 



path ordering y LPO on T (induced by >-) is defined as follows, cf. jl5l |. 
Definition 3.2.1. s >- LP0 t iff 

(i) t G var(s) and s ^ t, or 

(ii) s = fj(si, . . . ,s m ), t = fi(ti, . . .,t n ), and 

- there exists k (1 < k < m) with Sk ^lpo t, or 

- j > i and s ^ LP0 t/ for all i = 1, . . . , n, or 

- i = j and s y LPO ti for alH = 1, . . . , n, and there exists an i$ (1 < iq < m) 
such that si =ti,... s io -i = t io -i and s i() ^ LP0 t io . 

Proposition 3.2.1. (Kamin-Levy). 

(i) If s ^ L po t, then var(t) C var(s). 

(ii) For any total order -< on E, the induced lexicographic order ^ LPO is a simplification 
order on T. 

(iii) If R is a rewrite system such that — >r is contained in a lexicographic path ordering, 
then R is terminating. 

Proof. Folklore. □ 

3.3 Ordinal Terms and the Lexicographic Path Ordering 

Let N be defined as in the previous section. In this section we define a set of terms T (and 
a subset PcT) together with a well-ordering < on T. The elements of T are built from 
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3.3 Ordinal Terms and the Lexicographic Path Ordering 



0, + and the (N + l)-ary function symbol ip. It is important to note that the elements 
of T are terms not ordinals. Although these terms can serve as representations of an 
initial segment of the set of ordinals On, we will not make any use of this interpretation. 
In particular the reader not familiar with proof theory should have no difficulties to 
understand the definitions and propositions of this section. However some basic amount 
of understanding in proof t heory ma y be useful to grasp the origin and meaning of the 
presented concepts, cf. 47, 105 . 133| |. For the reader familiar with proof theory: Note 
that P corresponds to the set of additive principal nu mbers in T, while tp represents the 
(set-theoretical) fixed-point free Veblen function, cf. 1331 . 105l |. 

Definition 3.3.1. Recursive definition of a set T of ordinal terms, a subset P C T, and 
a binary relation > on T. 

(i) G T. 

(ii) If ai, . . . , a m G P and a% > ■ ■ ■ > a m , then a\ + • • • + a m G T. 

(iii) If a%, . . . , ctjy+i G T, then ift(ai, . . . , ajy+i) 6 P and ip(ai, . . . , ajy+i) G T. 

(iv) a^O implies a > 0. 

(v) a > (3\, . . . , p m and a G P implies a > f3\ + ■ ■ ■ + (3 m . 

(vi) Let a = a% + • • • + a m , (3 = @\ + ■ ■ ■ + n . Then a > f3 iff 

- m > n, and for all % (i G {1, . . . , n}) a« = or 

- there exists i (i G {1, ...,m}) such that ai = /3i,...,aj_i = and 

(vii) Let a = tp(ai, ■ ■ ■ , ajy+i), /? = • • • , Pn+i)- Then q > /3 iff 

- there exists k (1 < < N + 1) with > /3, or 

- a > Pi for all Z = 1, . . . , N + 1 and there exists an iq (1 < iq < N + 1) such 
that ai = Pi,... a io -i = p io -\ and a io > p io . 

We use lower-case Greek letters to denote the elements of T. Furthermore we formally 
define a + = + a = a for all a G T. 

We sometimes abbreviate sequences of (ordinal) terms like a±,. . . ,a n by a. Hence, 
instead of ip(cti, ■ ■ ■ ,«at+i) we may write ip(a). To relate the elements of T to more 
expressive ordinal notations, we define 1 := ip(0), u> := ^(0, 1), and eo := ip(0, 1,0). Let 
LlM be the set of elements in T which are neither nor of the form a + 1. Elements of 
LlM are called limit ordinal terms. 

Proposition 3.3.1. Let (T, <) be defined as above. Then (T, <) is a well-ordering. 

Proof. Let |a| denote the number of symbols in the ordinal term a. Exploiting in- 
duction on |a| one easily verifies that the ordering (T, <) is well-defined. To show 
well-foundedness one uses induction on the lexicographic path ordering ^ LP0 , exploiting 
the close connection between Definition I3.2.1liil in Section 13.21 and Definition 13.3. 1 Iviil 
above. □ 
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In the following proposition we want to relate the order type of the well-ordering (T, <) 
and the well-partial ordering ^ LP0 - Concerning the latter it is best to momentarily 
restrict our attention to the well-ordering (7"(S), -< LPO ). We indicate the arity of the 
function symbol ip employed in Definition 13.3.11 We write {T{N + 1),<) instead of 
(T, <). Similarly we write (T(£(iV)) 

i ^lpo) to indicate the maximal arity of fun ction 
symbols in the finite signature E. Let @q^(0) denote the small Veblen ordinal 1331 ] and 
let otyp(M) denote the order type of a well-odering M. 

Proposition 3.3.2. (i) For any number k, there exists an order isomorphic embed- 
ding from (T(E(fc)), ^ LP0 ) into (T(k + 1), <). 

(ii) For any number k > 2, there exists an order isomorphic embedding from (T(k), <) 
into (T(E(fc)),^ LPO ). 

(iii) sup fc<w (otyp((T(fc),<))) = S up fe< >typ((T(£(fc)),^ LPO ))) = 6^(0). 

Proof. The first two assertions are a consequence of the well-ordering proof of (T, <). 
We only comment on the stated lower bound in the second one. The statement fails for 
(T(2),<) and (T(E(2)), -< LPO ). The presence of the binary function symbol + in T(2) 
can make the ordering < more e xpres sive than ^ LPO - This difference vanishes for k > 3. 



The third assertion follows from 1301 ] . □ 



ISaC0(7l,- • -,7iV+l)) 



3.4 Fundamental Sequences and Sub-recursive Hierarchies 

To each ordinal term a € T we assign a canonical sequence of ordinal terms (a[x] : x £ 
IN), the fundamental sequence. The concept of fundamental sequences is a crucial one 
in (ordinal) proof theory. The main idea of utilizing fundamental sequences in term 
rewriting, is that the descent along the branches of such a sequence can, informally 
speaking, code rewriting steps. We have to wade through some technical definitions. 

We define the set IS^y), the set of interesting subterms of 7 (relative to a) by in- 
duction on 7. We set ISq(O) := 0, IS s (7i + • • • + j m ) := UfcLi lSa(7*)j and finally 

f {^(7)} if (7l,---,7iv) >lex (ai,...,ajv) 

I US'lSa^) otherwise. 

The (relative to a) maximal interesting subterm MS^(7i, . . . ,7 n ) of a non-empty se- 
quence (71, . . . ,7 n ) is defined as the maximum of the terms occurring in ISs(7i). Let 
> LEX denote the lexicographic ordering on sequences of ordinal terms induced by >. Let 
a = ai, . . . , aj\r £ T an d S T. Then set 

Fix (a) := {^(7) ^) : 7 >lex ck and ^(7, 6) > a, for all i = 1, . . . , N} 

For a unary function symbol / we define the n th iteration f n inductively as (i) f°(x) := 
x, and (ii) f n+l (x) := f(f n (x)). We will make use of this notation for functions of higher 
arity by assuming that all but one argument remain fixed. We use • to indicate the free 
position. In the sequel A (possibly extended by a subscript) will always denote a limit 
ordinal term. 
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Definition 3.4.1. Recursive definition of a[x] for x < to. 



n 
u 


X J 


— n 




Xj 


— rv i —1— ■ • • —1— /'v t ttj """> 1 rv 1 ^> • • • ~> 




x] 
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— u 


,1,(7) R 4- Fl 


X J 


— ib(Ti ft) • (t a- 1) 


ib(0 X) 




= ?/>(0 Atal) A ^ Fixfift 


ib(0, X) 


[xl 


= A • (x + 1) AG Fix(0) 


lh(n-\ on + 1. 0. 0) 


\x] 


= i/?('ai,...,ai,-,0l a!+1 f0') 


ih(nn rv -l-1 fT /9 -1- 'H 
<PV u; l ) ' ' ' ' U * ' ' U ' ' / 


Xj 


— th(m nt- ■ T\) x+1 (ih(rvi rn- 4- 1 fl'H 

— </-^ ( -»l, • • • j <-*i, , <-V ^^u:i , . . . , ul% -\- J., u, 


^(ai, . . . ,cti + 1,0, A) 


x] 


= ^(ai, . . . , cti + 1,0, A[x]) A^Fix(a,0) 


^(ai, . . . 3 Oi + 1,0, A) 


x] 


= ^(ai ) ...,a i ,-,U) !B+1 (A) AeFix(a,0) 


ip(ai, Aj,0, 0) 


x] 


= ^?(ai, . . . , Ai[x], 0, MS 5Ai o(a, A*)) 


^(ai,... ,Ai,0,/3 + 1) 


x] 


= • • • , Aj[x],0, ip{a 1} . . . , A,,0,/3)) 


V>(ai, . . • , Ai,0, A) 


x] 


= ^(ci!i,...,Ai,0,A[x]) A^Fix(a,0) 


V>(ai,...,Aj,0, A) 


x] 


= ^(ai, . . . , Aj[x], 0, A) AeFix(a,0) 



The above definition is given in such a way as to simplify the comparison between 
the fundamental sequences for T and the fundamental sequences for the set of or dina l 
terms T(2) (built from 0, +, and a 2-ary function symbol ip) as presente d in 1461 ] . 
Note that our definition is equivalent to the more compact one presented in 1051 ] . The 
following proposition is stated without proof. A proof (for a slightly different assignment 
of fundamental sequences) can be found in [311 ] . 

Proposition 3.4.1. Let a G T be given; assume x < u. If a > 0, then a > a[x]. For 
a > 1 we get a[x] > 0, and if a € LlM, then a[x + 1] > a[x]. Finally, if (3 < a € LlM, 
then there exists x < to, such that /3 < a[x] holds. 

In the definition of ip(a±, . . . , Aj, 0, 0)[x] we introduce at the last position of ip the term 
MS^q(ZS). We cannot simply dispense of this term. To see this, we alter the definition of 
the crucial case. We momentarily consider only 3-ary ^-functions; we set To := "0(1, 0, 0) 
and calculate tp(0, Tq, 0)[x]: 



^(o,r ,o)[x] 



< 



^(0,V(1,0,0)[x],0) 

V(o,^(o,-,or +1 (o),o) 

^(o,-,or +2 (o) 

^(1,0,0) . 



Hence for every x < u; ip(0, Tq, 0)[x] < To holds. This contradicts the last assertion 
of the proposition as To < ^(0, To,0). As a side-remark we want to mention that the 
given assignment of fundamental sequences even fulfills the Bachmann property, see 17]. 
Utilizing Definition 13.4.11 we are now in the position to define sub-recursive hierarchies 
of ordinal functions. 
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Definition 3.4.2. (The slow-growing hierarchy). Recursive definition of the function 
G a : u — > u for a € T. 



G (x) 
G a+ i(x) 
G x (x) 



G a (x) + 1 

G x[x ](x) . 



Definition 3.4.3. (The fast-growing hierarchy.) Recursive definition of the function 



F n : u> — > u for a G T. 



F (x) 
F a+1 (x) 
Fx(x) 



x + 1 

F x[x](x) 



It is easy to see that G a (x) < F a {x) for all a > 0. To see that the name of the 
hierarchy {G a '■ « € T} is appropriate, it suffices to calculate some examples. Take e.g. 
G u : G u (x) = G^y^ x+1) {x) = G x+1 (x) = G x (x) + 1 = x + 1. 

Recall that a function / is elementary (in a function g) if / is definable explicitely from 
0, 1, +, — (and g), using bounded sum and product. E(g) denotes the class of all such 
functions /. Then G t0 majorizes the elementary functions E. In contrast the function F^ 
already majorizes the primitive recursive functions, i.e. its growth rate is comparable to 
the (binary) Ackermann function. Furthermore the class of mult i ple r ecursive functions 



1251 . 



127]. 



146l | for further reading on the Hierarchy 



can be characterized by the hierarchy {E(F^) : 7 < uj^}, cf. 

However, the following theorem states a (surp rising) connection between the slow- 
and fast-growing hierarchy. See e.g. [ 
Comparison Theorem. 

Theorem 3.4.1. (The Hierarchy Comparison Theorem. 

(jE(G a )= |J E(FJ 



7<w 



N+l 



14fi| the 



Proof. We do not give a detailed proof, but only state the main idea. In 
hierarchy comparison theorem has been established for the set of ordinal terms T(2) 
(built from 0, +, and the function symbol tp, whe re ai (tjj) = 2). To extend the result to 



T it suffices to follow the pattern of the proof in 146| | . 



The difficult direction is to show that every function in the hierarchy {F-y : 7 < u + } 
is majorized by some G a . To sh ow this one in particular needs to extend the proofs of 
Lemma 5 and Theorem 1 in [1461 ] adequately. The reversed direction follows by standard 
techniques, cf. [3^]. □ 



3.5 The Interpretation Theorem 

For all a £ T there are uniquely determined ordinal terms a% > • • • > a m € P such that 
a = a\ + ■ ■ ■ + a m holds. In addition, for every a G P there exist unique ati, . . . , ajv+i 
such that a = ip(ai, . . . , ajv+i). (This normal form property is trivial by definition.) 
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Now assume a, (3 G T with a = 71 + • • • + 7 mo > P = 7m +i + • • • + 7m- Then the natural 
sum a#f3 is defined as 7pm + • • • + 7 p ( m ), where /O denotes a permutation on {1, ... , m} 
such that 7 p (i) > ■ ■ ■ > 7 p ( m ) holds. 

Let R denote a finite rewrite system whose induced rewrite relation is contained in 

^LPO- 

Definition 3.5.1. Recursive definition of the interpretation function ir: — > T. 

Let iV denote the maximal arity of a function symbol in S. If s = fj G S, then set 
tt(s) := VKi, 0). Otherwise, let s = fj(si, . . . , s m ) and set 

tt(s) := i)(j,ir(si), . . . ,vr(s m ) + 1,0) . 

In the sequel of this section we show that ir defines an interpretation for R on (T, <); 
i.e. we establish the following theorem. 

Theorem 3.5.1. For all s,t £ T(Y<) we have s — >r t implies ir(s) > Tr(t). 

Unfortunately this is not strong enough. The problem being that a > (3 implies that 
G a majorizes Gp, only. Whereas to proceed with our general program — see Section IBTTI — 
we need an interpretation theorem for a binary relation >- on T, such that a >- (5 
G a (x) > Gp(x) holds for all x. We introduce a notion of a generalized system of 
fundamental sequences. Based on this generalized notion, it is then possible to define a 
suitable ordering y. 

Definition 3.5.2. (Generalized system of fundamental sequences for (T, <).) Recursive 
definition of (a) x for x < u. 

(i) (Of := 

(ii) Assume a = a± + ■ ■ ■ + a m ; m > 1. Then j3 G (a) x if either 

- f3 = a\# ■ ■ ■ a* ■ ■ ■ #a m and a* G {oti) x holds, or 

- f3 = oti. 

(iii) Assume a = ip(a). Then (3 G (a) x if 

- /3 = ip(ai, . . . , a*, . . . , ayv+i), and a* G (ai) x , or 

- (3 = Ui + x, where a.- L > 0, or 

- (3 = i>(a)[x). 

By recursion we define the transitive closure of the ownership (a) x 3 /?: (a >m (3) «-> 
(37 G (a) x (7 >(x) /9V7 = /?)). Let q,/3 G T. It is easy to verify that a >( x ) P (for some 
x < uj) implies a > (3. If no confusion can arise we write a x instead of (a) x . 

Lemma 3.5.1. (Subterm Property) Let x < uj be arbitrary, 
(i) a <(x) 7i # ■■■of- #7 m . 
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(ii) a < (a! ) ^(7i,...,a,...,7jv+i). 

Proof. The first assertion is trivial. The second assertion follows by the definition of 
<r x \ and assertion □ 

Lemma 3.5.2. (Monotonicity Property) Let x < to be arbitrary. 

(i) If a > {x) ft, then 7 X # • • • a ■ ■ ■ #7 m > {x) 71 # •••/?••• #7 m . 

(ii) If a > (x) /3, then ^(71, . . . ,a, . . . ,7JV+l) >(*) ^(7i>- •• > -,7JV+i)- 

Proof. We employ induction on a to prove H]). We write (ih) for induction hypoth- 
esis. We may assume that a > 0. By definition of a >m ft we either have (i) 
that there exist 5 € a x and 5 >f x \ ft or (ii) [3 € a x . Firstly, one considers the lat- 
ter case. Then (71 # • • • (3 ■ ■ ■ #7 m ) € (71 # • • • a ■ ■ ■ #7™,)^ holds by Definition 13.5.21 
Therefore (7i# •••/?••• #7 m ) <f x \ (71 # • • • a • • • #7m) follows. Now, we consider the 
first case. By assumption (5 >( x .) /5 holds, by (ih) this implies (7i# •••<$••• #7 m ) >( x ) 
(71 # ■ • • P ■ ■ ■ #lm) x - Now ( 7l # • • • a ■ ■ ■ # 7m ) > {x) (71 # • ■ ■ <5 • ■ ■ # 7m ) follows by defi- 
nition of >(x)> if we replace /? by 5 in the proof of the second case. This completely 
proves [I]) . 

To prove [n|) we proceed by induction on a. By definition of a >r x \ (3 we have either 
(i) 5 € a x and 6 >r x \ (3 or (ii) f3 € a x . It is sufficient to consider the latter case, 
the first case follows from the second as above. By Definition 13.5.21 [3 G a x implies 
^(71, ...,(3,.. . ,7iv+i) G ^(71, . . . ,a, . . . ^Af+i) 21 - □ 

In the sequel we show the existence of a natural number e, such that for all s,t £ T, 
and any ground substitution p, s -^rI implies Tt(sp) >t e \ ft(tp). Theorem 13.5.11 follows 
then as a corollary. The proof is involved, and makes use of a sequence of lemmas. 

Lemma 3.5.3. Assume a, (3 G Lim; x > 1. If a >( a .) /?, then a >r x +x\ (3 + 1 holds. 

To prove the lemma we exploit the following auxiliary lemma. 

Lemma 3.5.4. We assume the assumptions and notation of Lemma 13.5.31 assume 
Lemma [3.5.31 holds for all 7, <5 € LlM with 7, S < a. Then a >( x +i) ca[x + 1] >i x+ \\ 
a[x] + 1. 

Proof. The lemma follows by induction on the form of a by analyzing all cases of Defi- 
nition I3XT1 □ 

Proof, (of Lemma [3.5.3p The proof proceeds by induction on the form of a. We consider 
only the case where a = ip(ai, . . . , ajv+i)- The case where a = a\ + ■ ■ ■ + a m is similar 
but simpler. 

By definition of a >r x \ (3 we have either (i) 7 € a x and 7 >t x ) ft or (ii) ft G a x . 
Assume for 7 € a x we have already shown that 7 + 1 <c x +i) a. Then for ft <i x \ 7, we 
conclude by (ih) and the Subterm Property (3+1 <(a;+i) 7 <(x+i) 7 + 1 <(x+i) a - Hence, 
it suffices to consider the second case. We proceed by case distinction on the form of ft. 
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Case = ip(ai, . . . , a*, . . . , ajv+i) where a* G (a.i) x for some i (1 < i < N + 1). Note 
that Qj < a, hence (ih) is applicable to establish a* + 1 <( x +i) «i. 

Furthermore by the Subterm Property follows a* <( x +i) a* + 1 and therefore 

ip(ai, ...,<**,.. . ,0/v+i) <(x+i) ■ ■ ■ »«* + • 

holds with Monotonicity. Applying (ih) with respect to ip(ai, . . . , a* + 1, . . . , ajy+i) we 
obtain 

V>(«i, • • • ,a*, . . . ,a N+ i) + 1 <( x+ i) ip(ai,...,a* + l,...,a N+ i) 

<(x+l) ^("1, • • • • • • ,ckn+i) = a . 

The last inequality follows again by an application of the Monotonicity Property. 
Case (5 = on + x: Then (on + x) + 1 = a« + (x + 1) <( x +i) a. 

Case /3 = ijj(a)[x]. Clearly (3 e LiM. Then the auxiliary lemma becomes applicable. 
Thus ip(a)[x] + 1 <( x+ i) a[x + 1] <( x +i) a. □ 

Lemma 3.5.5. Let t 6 T(£) be given. Assume r(i) < d, and fj € S. If /j ^ LP0 t, then 

>(2d) *■(*)■ 

Proof. We proceed by induction on r(t). In the presentation of the argument, we will 
frequently employ the Subterm and the Monotonicity Property without further notice. 
Set a := Tr(fj), and (3 := vr(t). Furthermore it is a crucial observation that <( x ) a 
holds for any x < lo, a € T. (This follows by a simple induction on a.) 

Case r(t) = 0: Then by assumption t = fi G S, i < j. Hence i <(2d) J holds and we 
conclude vr(t) = ^(i,0) < (2d) ^(j',D) = ir(fj). 

Case r(t) > 0: Let t = fi(h, . . . ,t n ). Set (3i := 7r(tj) for all Z = l,...,n. By (ih) 
one obtains (3i <(2<d-i)) a f° r an ^- F° r an ^ we need only consider the case where 
Pi G a 2<yd ~ l \ We consider ^(j, 0)[2d] and apply the following sequence of descents via 

>(2d) = 

Y>(j,0)[2d] = V(J-1,-,0) M+1 (0)_ 

= ^■-l,^-l,-,0) 2d (0),0) 

>(2«o ^t? - i^O' - 1, ■,0) 2d - 1 (o) + 1,0) 

>( 2d ) ^- 1,^-1, ■,0) 2d - 1 (o),-,0) 2 ^ 1 (o) • 
v ~^ ' 

V>(j,o)[2(d-i)] 

We define 7i := ^(j,0)[2(d - 1)] and 7fe+ i := VKi - l,7i, ■ ■ ■ ,7k + 1,0) [2(d - 1)]. By 
iteration of the above descent, we see 

a[2d] = ^(j,0)[2d] 

>(2d) ^(j'-l,7l,---,7n + l,0) 

>(2d) ^(i-l,«[2(d-l)],...,a[2(d-l)] + l,0) (<5) . 
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Let I (1 < I < n) be fixed. By assumption we have A G (a) 2(ci 1 '. We proceed by case 
distinction on the definition of A- 

Assume A = V(j,0)[2(d - 1)]. Then 6 = tp(j - 1, a[2(d - 1)],... . ,a[2(d - 1)] + 

1,0). Assume A = ip(j*,0), where j* € (j) 2 *- d_1 \ i.e. j* <(2d) 3 ~ 1 <(2d) J- Therefore 
a[2(d-l)] > {2d) ^(i-1,0). Hence S> (M) ^(j-1, a[2(d-l)], a[2(d-l)]+l, 0). 

Finally assume ft = j + 2(d - 1). Then A <( 2 (d-i)+l) VXi ~ !>°) <(2(d-i)+i) VKi ~ 
l,-,0) 2d_1 (0) = a[2(d - 1)]. Hence A < (2d) a[2(d - 1)] by Lemma EX3] and therefore 
^ >(2d) V<i - 1, a[2(d - 1)], . . . , A, • • • ,«[2(d - 1)] + 1,0). 

As Z was fixed but arbitrary, the above construction is valid for all L And the lemma 
follows. □ 

Lemma 3.5.6. Let fi(tt, . . . ,t n ),fj(st, . . . ,s m ) € T(£) be given; let d > 0. Then 

(i) If i < j, n(fj(s)) >( 2 (d-i)) tt(^) for all Z = 1, . . . , n. Then 7r(/ 3 -(s)) > (2d) 7r (/*(*)) 
holds. 

(ii) If si = ti,...,s io _i = vr(s io ) >(2(d-l)) 7r(*i )> and ^(/j^)) >(2(d-i)) tt(^)> 
for all / = io + 1, • • • , n, then n(fj(s)) >(2d) ^(/tC*)) holds. 

Proof. The proof of assertion is similar to the proof of assertion [n]) but simpler. Hence, 
we concentrate on|n]). Set a := n(fj(s)); (3 := 7r(/j(i)); finally set a, := 7r(sj) for all 
£ = 1, . . . , m, and A := 7r(t : £) for all £ = 1, . . . , n. As above, we consider only the case 
where A 6 (a) 2 ^" 1 ^ The other case follows easily. 

a[2d] = V0>i,--->«m + l,0)[2d] 

= • ,a m ,V>(j,ai, • • • , •, 0) M (0), 0) 

>(2d) ~4>ti,ai,-- ■ ,a m ,ip(j,a>i,. . . , a m , •, 0) 2d_1 (0) + 1,0) 

= tp(j, at, . . . ,a m ,ip(j, at, . . . ,a m + 1,0) [2(d - 1)] +1,0) . 

S v ' 

a[2(d-l)] 

Similar to above, we define 71 := a[2(d — 1)] = ip(j, a±, . . . , a m + 1, 0)[2(cZ — 1)] and 
7 fc+ i := ip(j,at,. ■ . ,a m ,7i, . . .,7^+1 + 1,0) [2(cZ - 1)] and obtain 

ot[2d] >(2d) • • • ,a m ,7i, • • • ,7Ar- m + 1) 

>(2d) ip{j' a i>- ■ ■ ,<x m ,a[2(d - 1)],. . . ,a[2(d - 1)] + 1) 
>(2d) i>{j\at, . . . ,a io ,0,a[2(d - 1)] + 1) . 

By assumption A <(2(d-i)) a «o and by Lemma T3.5.3I this implies A + 1 <(2d) a «o- 
We set a := at, ■ ■ ■ , «i -i, then we obtain 

ip(j,a,a io ,Q,a[2(d-l)] + l) > (M) a, A + 1, 0, a[2(d - 1)] + 1) 

>(2d) ^(J,a, A + l,0,a[2(d - 1)] + l)[2d] 

>(2d) ^(j,a,f3 io ,tp(j,a,fi io + l,0,a[2(d- 1)]),0) 

>(2d) #7\a,/3 io ,a[2(d-l)] + l),0) 

= V(j,A,---,A ,«[2(d-l)] + l),0) . 
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As in the first part of the proof, we obtain a[2d] >(2d) ip(j, os, aj , 0, a[2(d— 1)]+1) >(2d) 

>(2d) 1>U, Pi , ■ ■ ■ , Pi , a[2(d - 1)], . . . , a[2(d - 1)] + 1, 0) . 

By assumption we have Pi <(2(d-i)) a f° r all Z = 1, . . . , re. It remains to prove that 
this implies Pi <(2d) 7- For this it is sufficient to consider the case where Pi G (a) 2 ^ -1 ). 
The proof proceeds by case-distinction on the construction of Pi. The proof is similar to 
the respective part in the proof of Lemma 13.5.51 and hence omitted. □ 

Lemma 3.5.7. Let s, t G T be given. Assume s = fj(si, . . . , s m ), p is a ground substi- 
tution, r(t) < d. Assume further Sk ^lpo u and r(u) < d implies ir(skp) >(2d) ft(up) for 
all u G T . Then s >- LPO t implies vr(sp) >{2d) n (tp)- 

Proof. The proof is by induction on d. 

Case d = 0: Hence r(t) =0; therefore ieV or £ = Consider t G V. Then t is 

a subterm of s. Hence there exists k (1 < k < m) s.t. t is subterm of s&. Hence ^ L po t, 
and by assumption this implies ir(skp) >(2d) ^{tp), and therefore ir(sp) >{2d) ^{tp) by 
the Subterm Property. 

Now assume t = fi G E. As s ^ LPO i by assumption either i < j or ^ L po * holds. 
In the latter case, the assumptions render ir(skp) >{2d) ^(tp)) hence 7t(sp) >(2d) ^(tp). 
Otherwise, n(sp) = ifi(j, 7r(sip), . . . ,7r(s m p) + 1,0), while ir(tp) = Tr(t) = ip(i,0). As 
ir(skp) >( x ) holds for arbitrary x < u, we conclude ir(sp) >(2d) n(tp). 

Case d > 0: Assume r(i) > 0. (Otherwise, the proof follows the pattern of the case 
d = 0.) Let t = fi(t±, . . . , t n ), and clearly r(ti) < (d — 1) for all I = l,...,n. We 
start with the following observation: Assume there exists io s.t. s y LP0 ti holds for all 
I = io + 1, . . . , re. Then by (ih) we have 7r(sp) >(2(d-i)) ^{Up)- 

We proceed by case-distinction on s >- LPO t. Assume firstly there exists k (1 < k < m) 
s.t. Sk ^ L po t. Utilizing the assumptions of the lemma, we conclude ir(sp) >(2d) ^(^P)- 
Now assume i < j and s y LPO ti for all I = 1, . . . , n. Clearly sp, tp G T{Y,). By the 
observation ir(sp) >(2(d-i)) ^(Up) holds. Hence Lemma r3.5.6lil becomes applicable and 
therefore ir(sp) >{2d) n (tp) holds true. Finally assume i = j; si = t±, . . . , Sj _i = £j -i; 
s i ^lpo hot s ^lpo ti, for all I = io + 1, . . . ,m. Utilizing the observation, we see that 
Lemma f3. 5. 6liil becomes applicable and therefore vr(sp) >{2d) 7r (*/ 5 )- D 

Lemma 3.5.8. Let t G be given, assume r(i) < d. Then tp(K + 1, 0) >{2d) 7r (^)- 

Proof. The inductive proof follows the pattern of the proof of Lemma 13.5.51 □ 

Theorem 3.5.2. Let l,r G T be given. Assume p is a ground substitution, r(i) < d. 
Then / ^ LPO r implies n(lp) >^d) n(rp). 

Proof. We proceed by induction on r(s). 

Case t(s) = 0: Then s can either be a constant or a variable. As s y LP0 t holds, 
we can exclude the latter case. Hence assume s = fj. As fj y LPO t, t is closed. Hence 
the assumptions of the theorem imply the assumptions of Lemma [3. 5.51 and we conclude 
7r(sp) = vr(s) >(2d) 7r(t) = ir(tp). 
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3 Relating Derivation Lengths with the Slow-Growing Hierarchy Directly 



Case t(s) > 0: Then s can be written as fj(si,...,s m ). By (ih) s& ^ L po u and 
t(u) < d imply ir(skp) >(2<f) K(tp). Therefore the present assumptions contain the 
assumptions of Lemma 13,5.71 and hence vr(sp) >(2d) n(tp) follows. □ 

Theorem 3.5.3. (The Interpretation Theorem.) Let R denote a finite rewrite system 
whose induced rewrite relation is contained in ^ L po- Then there exists k < u, such that 
for all l,r G T, and any ground substitution p I — >^ r implies n(lp) >r^\ n(rp). 

Proof. Set d equal to max{r(r) : 3/ (l,r) G R}. Then the theorem follows as a corollary 
to Theorem 13.5.21 if k is set to 2d. □ 

3.6 Collapsing Theorem 

We define a variant of the slow-growing hierarchy, cf. Definition 13.4.21 suitable for our 
purposes. 

Definition 3.6.1. Recursive definition of the function G a : uj — > uj for aeT. 

G (x) := 

G a (x) := max{G /3 (x) : G (a) x } + 1 . 
Lemma 3.6.1. Let a G T, a > be given. Assume x < u is arbitrary. 

(i) G a is increasing. (Even strictly if a > uj.) 

(ii) If a >i x ) (3, then G a (x) > Gp(x). 

Proof. Both assertions follow by induction over < on a. □ 

We need to know that this variant of the slow-growing hierarchy is indeed slow- 
growing. We show this by verifying that the hierarchies {G a : a G T} and {G a : a G T} 
coincide with respect to growth-rate. It is a triviality to verify that there exists (5 G T 
such that Gp majorizes G Q . (Simply set = a.) The other direction is less trivial. 
One first proves that for any a G T there exists 7 < co N+1 such that G a (x) < F^(x) for 
almost all x. Secondly one employs the Hierarchy Comparison Theorem once more to 
establish the existence of G T such that G a (x) < Gr{x) holds for almost all x. 

Theorem 3.6.1. 

|J E{G a ) = |J E(G a ) = |J E(F 7 ) . 
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3. 7 Complexity Bounds 



3.7 Complexity Bounds 

The complexity of a terminating finite rewrite system R is measured by the derivation 
length function. 

Definition 3.7.1. The derivation length function Dlr: lo — > u. Let m < oj be given. 
DLi?(m) := max{n : 3h, . . . , t n £ T ((t± -^r ■ ■ ■ ^r t n ) A (r(ii) < m))}. 

Let R be a rewrite system over T such that — *r is contained in a lexicographic path 
ordering. Now assume that there exist s = to, ti, . . . , t n E T with r(s) < m such that 

s ^r h -^r ■ ■ ■ — >R t n 

holds. By our choice of R this implies s y LP0 t% >- hP0 ■ ■ ■ ^ L po tn- By assumption on E 
there exists c € S, with ar(c) = 0. We define a ground substitution p: p(x) = c, for all 
x € V. Let k < u be defined as in Theorem 13.5.31 Recall that K denotes the cardinality 
of S. We conclude from the Interpretation Theorem and Lemma 13.5.81 Tr(sp) ><k) 
Tt(tip) >(fc) ••• >(fc) Tr(t n p) and ip{K + 1,0) >(2 m ) ^(^p)- Setting h := max{2m, fc} 
and utilizing Lemma T3.5.31 we obtain ip(K + 1,0) >[h) 7r ( s /°) >(h) ' ' ' >(h) ^{p n p). An 
application of Lemma I3.6.1liil yields 

G 4>(K+i,o)(h) > G^s^Qi) > ■ ■ ■> G^ tnP) (h) . 

Employing Theorem 13. 6. II we conclude the existence of 7 < uj u , such that 

F 7 (max{2m, k}) > G^ K+1 ^(max{2m,k}) > DL R (m) . 

The class of multiply-recursive functions is captured by U-y<w"< ^0^V)> see 127| |). Thus 



we have established a multiply-recursive upper bound for the derivation length of R if 
— >r is conta ined in a lexicographic path ordering. Furthermore, this bound is essentially 



optimal, cf. 144] 



3.8 Conclusion 

The presented proof method is generally applicable. Let R denote a rewrite system 
whose termination can be shown via >- M po- To yield a primitive recursive upper bound 
for the complexity of R the above proof can be employed. Firstly the definition of the 
interpretation function n has to be changed as follows. If s = fj(s%, . . . , s m ), then we set 

tt(s) :=^(j,vr( Sl )#...#7r( Sm )#l) . 

Then the presented proof needs only partial changes. It suffices to reformulate (and 
reprove) Lemma 13.5.51 13.5.61 13.5.71 an d 13.5.81 respectively. 

Future work will be concerned with the Knuth-Bendix ordering. Due to the more 
complicated nature of this ordering the statement of the interpretation is not so simple. 
Still we believe that only mild alterations of the given proof are necessary. 
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Abstract 

We define a new path order -< PO p so that for a finite rewrite system R compatible with 
^pop, the complexity or derivation length function Dl^ for each function symbol / is 
guaranteed to be bounded by a polynomial in the length of the inputs. Our results yield 
a simplification and clarification of the results obtained by Beckmann and Weiermann 
(Archive for Mathematical Logic, 36:11-30, 1996). 

4.1 Introduction 

Suppose C denotes an inductively defined class of recursive number-theoretic functions 
and suppose each / € C is defined via an equation (or more generally a system of 
equations) of the form 

/(x) = t(Ay./(y),x), (4.1) 

where t may involve previously defined functions. In a term-rewriting context these 
defining equations are oriented from left to right and the canonical term-rewriting char- 
acterisation Rc of C can be defined as follows: The signature £ of Rc includes for each 
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4 Proofs of Termination of Rewrite Systems for Polytime Functions 



function / in C a corresponding function symbol /. In order to represent natural numbers 
S includes a constant and a unary function symbol S. I.e. numbers are represented 
by their numerals. (Later we represent natural numbers in the form of binary strings.) 
For each function / £ C — {0, S}, defined by (|4.ip . the rule 

/(x)->i(Ay./(y),x) , 

is added to Rc- In all non-pathological cases the term rewrite system (TRS for short) 
Rc is terminating and confluent. Rc is best understood as a constructor TRS, where 
the constructors are and S. Hence Rc may be conceived as a functional program 
implementing the functions in C. 
Term-rewriting characterisations have been studied e.g. in 0, S3, OH, I22I. The 



analysis of Rc provides insight into the structure of C or renders us with a delineation of 
a class of rewrite systems whose complexity (measured by the length of derivations) is 
guaranteed to belong to the class C. Term-rewriting characterisations turn the emphasis 
form the definition of a function / to its computation. An essential property of term- 
rewriting characterisations Rc is its feasibility: Rc is called feasible, if for each n-ary 
function / £ C, there exists a function symbol g in the signature of Rc such that 
g(rh~i, ■ ■ ■ , m n ) computes the value of /(mi, . . . , m n ) and the derivation length of this 
computation is bounded by a function from C. 

We study term-rewriting characterisations of the complexity class FP. In particular, 
our starting point is a clever characterisation R' B of FP introduced by Beckmann and 
Weiermann. In [3] the feasibility of R' B is established and conclusively shown that any 
reduction strategy for R' B yields an algorithm for / £ FP that runs in polytime. We 
provide a slight generalisation of the fact that R' B is feasible. Moreover, we flesh out the 
crucial ingredients of the TRS R' B by defining a path order for FP, denoted as -<pop- We 
show that for a finite TRS R, compatible with -<p p, the derivation length function Dl^ 
is bounded by a polynomial in the length of the inputs for any defined function symbol 
/. Furthermore -<p p is complete in the sense that for any function / £ FP, there exists 
a TRS R computing / such that termination of R can be shown by ^ P op- 



4.2 A Rewrite System for FP 

In the following we need some notions from term rewriting and assume (at least nodding) 
acquaintance with term rewriting. (For background information, please see 15].) Let 
V denote a countably infinite set of variables and S a signature. The set of terms over 
£ and V is denoted as T(£, V), while the set of ground terms is written as T(Ti). The 
rewrite relation induced by a rewrite system R is denoted as — >r, and its transitive 
closure by — We write r(t) to denote the size of a term t, i.e. the number of symbols 
in t. 

Conventions: Terms are denoted by r,s,t, possibly extended by subscripts. We write 
t, to denote sequences of terms t±, . . . , tf, £ T(£, V) and g to denote sequences of function 
symbols gi,...,gk, respectively. The letters i,j, k,l,m, n, possible extended by subscripts 
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will always refer to natural numbers. The set of natural numbers is denoted as usual by 
N. 

We consider the class FP of polytime computable functions, i.e. those functions com- 
putable by a deterministic Turing machine M, such that M runs in time < p(n) for all 
inputs of length n, where p denotes a polynomial. We consider equivalent formulations 
of the class of polytime computable functions in terms of recursion schemes. 



Recursion schemes such as bounded recursion due to Cobham [4l| generate exactly the 
functions computable in polytime. In contrast to this, Bellantoni-Cook [21]] introduce 
certain unbounded recursion schemes that distinguish between arguments as to their 
position in a function. This separation of variables gives rise to the following definition 



of the predicative recursive functions B; for further details see 2l[. We fix a suitable 
signature of predicative recursive function symbols B. 



S^' 1 E B°<\ where i E [0,1]. 



Definition 4.2.1. For k, I E N we define B k)l inductively. 

i 

- Ur' 1 E B k ' 1 , for all r E [1, k + I]. 
_ po,i e B o,i 

_ C7°< 3 G s ' 3 . 

- Uf£B«> v ,g u ...,g k , and *n, . . . , h v E B^, 
then SUB^,[/,g,h] 6 5^. 

- If 5 E /i >i E S fc+1 ^ +1 , then PREC fc+1 ''[ 5 , /ii, h 2 ] E B*+ 1 » J . 
Set B:=U Me N^ M - 

To simplify notation we usually drop the superscripts, when denoting predicative 
recursive function symbols. Occasionally, we even write SUB (, PREC), instead of 
SUB fc -'[/,g] (,PREC n+1 [g,h]). No confusion will arise from this. 

The binary successor function m > 2m + i, i E {0, 1} is denoted as Si. Every natural 
number can be buildt up from with repeated applications of Si. The binary length of 
a number m is defined as follows: |0| := and |<Sj(m)| := \m\ + 1. 

We write N fc '' for N fc x N ; and for / : N k ' 1 — > N, write /(mi, . . . , m^; ni, . . . , n{) instead 
of /((mi, . . . , m&), (ni, . . . , n/}). The arguments occurring to the left of the semi-colon 
are called normal, while the arguments to the right are called safe. We define the 
following functions: <S?' , i E {0, 1} denotes the function (;m) i— > 2m + i. O k ' 1 denotes 
the function (m; n) i— > 0. Ur ,l denotes the function (mi, . . . , m^; m^+i, • • • , mk+l) l— * m r- 
V 0,1 denotes the unique number-theoretic function satisfying the following equations: 
/(;0) = 0, f(;Si(m)) = m. C ' 3 denotes the unique function satisfying: /(;0, mo, mi) = 
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m , f(\Si(m),mo,mi) = m,. If /: N k > l -» N, gi : N fe '° -> N for i G [l,k'], hy. W> 1 -► N 
for j € [1, Z'], then SUBy v [/, g, h] denotes the function 

(m;n) \-> /(c?i(m; ),..., g fc /(m; ); h(m; n), ...,fy/(m;n)) . 



If <?: N fe ' z -»■ N, /ti: N fc+1 ' m -> N for i G [0,1] then VK£C k+1 > l \g,h 1 ,h 2 } denotes the 
number-theoretic function / satisfying: /(0, m;n) = p(m; n) and /(<Sj(m), m; n) = 
hi(m, m; n, /(m, m; n)). 

Definition 4.2.2. For k,l G N we define B k ' 1 inductively. 

- S®' 1 G B ' 1 , where i G [0,1]. 

- O k ' 1 G £> fc,/ . 

- U k ' 1 G for all r G [l,fc + Z]. 

- P ' 1 G B ' 1 . 
_ C o,3 G ^0,3 

- Uf£B k '< 1 ', gi,..., g k > and /n, . . . , h v G £ fe >', then SUB k J v [f, g, h] G £ fe >*. 

- If g G B fe '', /iq, /ii G B*+ 1 .'+ 1 J then VR£C k+1 ' l [g, h u h 2 ] G £ fc+1 >'. 

The set of predicative recursive functions is defined as B = \J k , B k ' 1 . 

It follows from the definitions that for each / G B, there exists a unique predicative 
recursive function f s ; the latter is called the interpretation of / in B. For every number 
m we define its numeral fn G T(B, V) as follows: := 0, <Sj(; m) := S{(; m) for i G [0, 1]. 
We write m to denote a sequence of numerals m\ , . . . , m~k ■ Now the polytime computable 
functions FP can be defined as follows, see |2l| ]: 



FP = (J £ fc '° . 



In 19[] a clever feasible term-rewriting characterisation R' B of the predicative recursive 
functions B is given. By Bellantoni's result this yields a feasible term-rewriting charac- 
terisation of the class of polytime computable functions FP. The (infinite) TRS is given 
in Table 1. 

The TRS R' B is terminating and confluent. Termination follows by the multiset path 
order. Confluence is a consequence of the fact that R' B is orthogonal. Note the restriction 
in the rewrite rules for safe composition and predicative recursion. These rules only 
apply if all safe arguments are numerals, i.e. in normal-form. This peculiar restriction is 
necessary as the canonical term-rewriting characterisation Rb of B, admits exponential 
lower-bounds, hence Rb is non-feasible, compare. fl9l ] . 

Let R denote a TRS. A derivation is a sequence of terms tj, i G M, such that for all i, 
U —>R U+l- The (i + l) th element of a sequence a is denoted as (a)j. We write ^ for 
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Table 4.1: A Feasible Term- Rewriting Characterisation of the Predica- 


LJ (xj a) -^4M*f ixecuiDive runcnoiis 


r ~ ,-.1 
[zero] 


TfkJjf \ 

U [X\, . . . , Xk, . . . , Xk + l) — > x r , 


[projection] 


-r (;U) — ► U , 


[predecessor] 






C 0,3 (;0,a ,ai) -> a , 


[conditional] 


C°' 3 (;5i(;a),ai,a ) -> a 2 _i , 




SUB fc >U g, h](x; n) - /(g(x; ); h(x; n)) 


, [safe composition] 


PREC fc+1 ''bA,M(0,x;n) ^ 5 (x;n) , 


[predicative recursion 


PREC fc+1 -'b,/ ll ,M(^(^),x;n) -h- 


on notation] 


-> /i 4 (6, x; n, PREC fc+1 ' Z [g, /ti , fa] (6 


,x;n)) . 


We use the following notation: i G [0, 1] 


and r G [1, k + I]. 



the concatenation of sequences and define the length \a\ of a sequence a as usually. We 
define a partial order C on pairs of sequences, a C 6, if b is an extension of a, i.e. |a| < |b| 
and for all i < \a\ we have (a)j = A derivation <i with (d)o = i is called derivation 
starting with t. The derivation tree Tr(£) of t is defined as the structure (T(t), C), where 
T(£) := is a derivation starting with t}. The root of Tn(t) is denoted by t (instead 

of (/))• _ 

We measure the complexity or derivation length of the computation of /(m) by the 
height of 7}j(/(m)), i.e., we define the derivation length function Dl^: — > N: 

Dl^(m) := max{n | 3 t , . . . , t n G T(S) (t n « ^ . . . i = /(m))} . 

Based on these definitions we make the notion of feasible term-rewriting characterisa- 
tion precise. A term-rewriting characterisation Rq of a function class C is called feasible, 
if for each n-ary function / G C, there exists a function symbol 5 in the signature of i?c 
such that g(rh~i, . . . ,fn n ) computes the value of /(mi, . . . , m n ) and Dl^ c is bounded by 
a function from C. For the rewrite system R' B we have the following proposition. 

f 

Proposition 4.2.1. For every / Go, D1 R/ is bounded by a monotone polynomial in 
the length of the normal inputs. Specifically for each / we can find a number £(f) so 
that Dlt (m; n) < (2+ |m|) where |m| denotes the sum of the length normal inputs 
mi. 

Proof. See [?J for a proof, essentially we employ the observation that the derivation trees 
T R / B (f(m; n)) are isomorphic no matter how the safe input numerals n vary, to drop the 
dependency on the length of the normal inputs. □ 
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4.3 A Path Ordering for FP 

To extend the above results and to facilitate the study of the polytime computable 
functions in a term-rewriting framework, we introduce in this section a new path order 
for FP, which is a miniaturisation of the recursive path order, cf. [I5j, see also [3o| . 

In the definition we make use of an auxiliary varyadic function symbol 'list' of arbitrary, 
but finite arity, to denote sequences so, . . . , s n of terms. Instead of list(so, • • • , s n ) we 
write (so, ... , s n ). We write a for sequences a = (so, ... , s n ), b = (s n+ i, . . . , s n+m ) to 
denote the concatenation (so, ... , s n+m ) of a and b. 

Let X be a signature. We write T*(E, V) to denote the set of all finite sequences 
of terms in T(S,V). To ensure that T(E,V) C T*(X,V), any term is identified with 
the sequence list (t) = (t). We denote sequences by a,b,c, both possible extended with 
subscripts. Sometimes we write fa as abbreviations of /(to, • • • > t„), if a = (to, • • • , t n ). 

We suppose a partial well-founded relation on S, the precedence, denoted as <. We 
write / ~ g if (/ < g) A (g < /) and we write f > g and g < f interchangeably. Further, 
we suppose that the signature £ contains two unary symbols So, S\ of lowest rank in the 
precedence. I.e. X = {So, Si} U X' and So ~ Si and for all / G X', So, Si < f. Moreover, 
we define := (). For every number m we define its numeral m G T(X,V) as follows: 
:= (); Si(m) := S^m) for i G [0, 1]. 

The definition of the path order for FP (POP for short) -< PO p (induced by <) is based 
on an auxiliary order C The separation in two orders is necessary to break the st reng th 
of the recursive path order that induces primitive recursive derivation length, cf. 771 ] . 

Definition 4.3.1. Inductive definition of Q induced by <. 

(i) 3j G [l,n] (s C tj) =^ s C f(t u . . . ,t n ) , 

(ii) t = f(ti, ...,t n ) & s = g(si, . . . , s m ) with g < f k. Vi G [1, m] (s, C t) 
=> set. 

Definition 4.3.2. Inductive definition of ^ PO p induced by <; -< PO p is based on C 

(i) set =>■ s -< PO p t , 

(ii) 3j G [l,n] (s ^pop tj) =>- s -< POP /(ti, . . . ,t n ) & s ^ P0P (ti, • • • ,t n ) , 

(iii) t = f(ti, . . . , t n ) k, (m = or (3i (Vi / i (sj C t) & Sj ^ P0P t)) 

^ ( s l, • • • , s m) ^>POP t , 

(iv) t = /(t , ...,t n )k,s = g(so, . . . , s m ) with / ~ g & (s , . . . , s m ) ^ P0P (to, • • • , t n ) 
— ^ s ~^pop t , 

(v) a ss ao ^ • • • ^ a n k Vi < n (a^ ^ PO p bi) k 3i < n (a^ ^ PO p £>i) 

a ^pop (b , • • • , &n) if n > 1 , 

a ~ ao ^ • • • ^ a n denotes the fact that the sequence a of terms is obtained from 
the concatenated ao ^ • • • ^ a n by permutation. 
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Note that due to rule lull () ^ PO p a for any sequence a G T*(E, V). Further, we write 
s >- PO p t for t ^pop s. It is not difficult to argue that ^ PO p is a reduction order. A 
number of relations are missing; we mention only the following: 

- t = f(ti, . . . ,t n ) & s = g(s%, ...,s m ) with g < f & Vi G [1, m] (s, ^ P0P t) =>■ 

s ~*>POP ^- 

We indicate the reasons for the omission of this clause. 

Example 4.3.1. Consider the following TRS, where £ contains additionally the symbols 
a, h, f with precedence a, h < f , g < h. 

/(0) -> a /(£(*)) -> /*(/(*)) fc(x) -> s(x, x) . 

It is easy to cannot handle the TRS in the example, but would if rule 

above is included. However, note that the TRS admits an exponential lower-bound on 
the derivation length function. 

We introduce suitable approximations -< k of -< P op- 

Definition 4.3.3. Inductive definition of el induced by <; we write \Z k to abbreviate 

(i) 3j G [1, n] (s Q{ tj) =^ s 4 /(t , ■ ■ ■ , *n) , 

(ii) £ = /(t , . . . ,t n ) & s = g(s , ...,s m ) with g < f & m < k & Vi (si d l k t) 

Definition 4.3.4. Inductive definition of -< k induced by <; -< k is based on \Z k . 

(i) s Cfe t =>- s -< k t , 

(ii) 3j G [l,n] (s ^) => s -< k f(t 1} . . . ,t„) , 

(iii) t = f(ti, ...,*„)& (m = or 3i G [1, m] (Vi / i («i Cfc *) & «i -<fc 0) 
& m < (si, . . . , s m ) -< k t , 

(iv) t = /(t , . . . , t n ) & s = g(s , ...,s m ) with / ~ g k (s , ...,s m )< k 
(to, . . . , t n ) & m < maxjfc, n} ==> s ~( k t , 

(v) a « ao ^ ■ • • ^ a n & Vi < n (a, 6j) & 3i < n(aj -<£ 6j) =>■ a -<£ 
(6 ,...,&„) if n> 1 . 

In the following we prove that if for a finite rewrite system R, R G^ P0P , then it even 
holds that — >R<Z~< k , where k depends on R only. 

Lemma 4.3.1. If s -< k t and k < I, then s -<i t. 

We introduce the auxiliary measure |.|: T*(E, V) — > N: (i) |x| := 1, x G V, (ii) 
|(si, . . . ,s n )| := max{n, \si\, \s n \}, (iii) |/o| := \a\ + 1. 
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Lemma 4.3.2. If s -< POP t, then for any substitution a, sa -<\ s \ ta. 

Lemma 4.3.3. If t = /(ti, t n ), s = f(ti, . . . ,u, . . . ,t n ) with u -< k v, where 
k > max{ar(/) : / G S}, then s -< k t. 

Recall that ^ PO p is a reduction order. Hence the assumption R Q~< P0P implies 
^_r^-<pop- 

Lemma 4.3.4. Let k = max{max{r(r)|(7 — ► r) £ R}, max{ar(/)|/ E S}}. Then t -^r s 
implies s -< k t. 

We set 

Gfc(cr) := max{n G N | 3(a , ■■■ ,a n ) (a n -< k ■ ■ ■ -< k a = a)} , 
Fk, P ( n ) := max{G fc (/a) : rk(/) = p Sz G k (a) < n} , 

where rk(/) : S — > N is defined inductively: rk(/) := max{rk(g) +1: j G SA j /}. 
We collect some properties of the function G k in the next lemma. 

Lemma 4.3.5. (i) G k ((s , . . . , s n )) = YZ=o G k(<H)- 

(ii) Gfc(m) = \m\ for any natural number m. 

Lemma 4.3.6. Inductively we define dj.fi '■= 2 and c4, p -i '■= (d ktP ) k + 1- Then there 
exists a constant c (depending only on k and p) such that F kp {n) < c ■ n dk <p + c. 

Proof. The lemma is proven by main induction on p and side induction on a. 

Set a := (to, . . . ,t n ) and let u; -< k f(to, ■■■ ,t n ) =: i, rk(/) = p and u; maximal. By 
assumption G k (a) < n. We prove 

Gk(w) < cn dk ' p for almost all n , 

by case-distinction on the definition of -< k . Without loss of generality, we only consider 
the case u> = (r , . . . , r m ). 

Case, p = and Vi < m (r~j \Z k t). By definition of ^ PO p we have Vi < m 3j < n (rj < k 
tj). Then Gk(w) < Gfe(o) = n. Hence 

Gfc(w) < kn < en 2 , 

where we set c := k. 

Case, p = 0, Vi / io ( r i Efc i), an d rj t. By definition of ^ PO p we have Vi < 
m 3j < n (n < k tj) and r io = f(s , s t ), rk(/) = 0, with (s , . . . , s t ) < k a. Hence by 
induction hypothesis on a, there exists a constant c, such that G k (ri ) < c(n — l) 2 a.e. 
Employing Lemma 14, 3.51111) we obtain: 

m 

G k (w) = G fc ((r , . . . , r m )) = G k {n) < c(n - l) 2 + (k — l)n < cn 2 , 

8=0 
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as we can assume c > k. 

Case, p > and Vi < m (r« \Zk t). Let i be arbitrary. We can assume = g(so> • • • > s z)> 
g -< f, and Vi < / (s» C^ -1 Otherwise, if r» = g(so, • • • , sj) with g >~ f s.t. there 
3j < n (r; C tj) we proceed as in the first case. By induction hypothesis there exists c 
and d = s.t. F^in) < cn d a.e. 

We show the existence of a constant d s.t. < dn d , where d' = dk, p +i- We 

define /(a) := ca d and 5^ (a) := a, </' +1 )(a) = f(g"'(a) • k); we obtain: 

sc[t=>Gt(s) <<? ( V) a.e. (*) 
To see (*) we show by induction on I, that s IzL i implies Gfc(s) < g( l \n), where 

g®(n) = coa dW with Co = c^i=o d% k^i =1 d * . Suppose I > 0, then we obtain by induction 
hypothesis on the claim and Fk^ p {n) < cn d we obtain: 

G ft (a) < c[(c r/) • k] d = Cl n dl+ \.e. , 

I- 1 1 , i= o a fc^ i=1 . This accomplishes the claim. 
Now the upper-bound for Gk(w) follows: 

GfcH < kg (k) {n) < c'n d ' a.e. , 
where d = c^i=o d% k^i=o dl and d! = d k+1 + 1 = d k:P+1 . 

Case, p > 0, Mi 7^ i$ (r« \Z k t), and rj -< k t- By definition Vi < m 3j < n (r$ < k tj), 
and rj = /(So, . . . , sj) so that (sq, • • • , sj) -<fc a> Let c, c', d' be defined as above. By 
induction hypothesis on a we obtain G k (ri ) < d(n — l) d ' and thus 

G fe H < c'(n - I) d ' + (fc - f) • c • < cV . 

□ 

Recall the definition of the derivation length function: 

Dl£(m) = max{I | 3 to, . . . , t n € T(E) (i n . . . < ^ i = /(m))} 
We have established the following theorem. 

Theorem 4.3.1. If for a finite TRS R defined over T(E,V), -R C^ POP then for each 
J- 

/ £ E, Dl^j is bounded by a monotone polynomial in the sum of the binary length of the 
inputs. 

Proof. Let R be a finite TRS defined over T(E, V), such that for every rule (I — ► r) £ -R, 
r -< PO p £ holds. This implies that for any two terms t, s, t — >r s implies s -< P op t. Hence 
by Lemma [4.3.41 there exists k 6 N, s.t. <— R<Z~<k- Suppose / is an n-ary function symbol 
and set t := /(mi, . . . ,fn n ). By definition it follows that 

Dl^(mi, . . . ,rfi n ) < G fc (/(mi, . . . ,m n )) . 

By Lemma [4.3.61 there exists a polynomial p, depending only on k and the rank of /, s.t. 

G fc (/(mi, . . . ,m„)) < p(G fc ((mi, . . . ,m n )) . 

Employing with Lemma 14.3.51 we obtain Drjj(mi, . . . ,m n ) < p(Y^=l\ m i\) ■ ^ 
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4.4 Predicative Recursion and POP 

In the previous section we have shown that if for a finite TRS R, defined over T*(£, V), 
R ^~<pop! then the derivation length function Dl^ is bounded by a monotone polynomial 
in the binary length of the inputs. As an application of Theorem 14.3-H we prove in 
this section that is bounded by a monotone polynomial in the binary length of 

the normal inputs. I.e. we give an alternative proof of Prop. 14.2.11 As R' B exactly 
characterises the functions in FP this yields that -< PO p — via the mapping S defined 
below — exactly characterises the class of polytime computable functions FP. 

It suffices to define a mapping S: T{B) — > T*(S), such that S is a monotone inter- 
pretation such that S(Zct) ^ pop S(r<r) holds for all (I — ► r) € R' B . We suppose the 
signature £ is defined such that for any function symbol / € B k)l there is a function 
symbol /' £ E of arity k. Moreover, £ includes two constants So, Si and a varyadic 
function symbol • of lowest rank. We need a few auxiliary notions: sn(n) := n for 
numerals n; sn(/(t;s)) = $^ 3 -(sn(sj)), otherwise. For every number m we define its 

representation fh G T(£, V) as follows: := •; Si{m) := »(Si) * fh for i E [0, 1], where 
•(so ■ ■ ■ ,Si) * •(sj+ij . . . , s n ) := •(so • • • j s n ). We define S : T(B) — > T*(£) by mutual 
induction together with the interpretation N: T(B) — > T*(£). 

Definition 4.4.1. 

- S(n) := () and S(Si(;t)) := (Sj)^S(i) for t ^ n (i.e. i is not a numeral). 

- For / + S h define S(/(t; s)) := (/(N(t ), • • • , N(t„)), S(s ), • • ■ , S(s m )). 

- N(t) := »S(t) * sn(t). 

First we show that for Q € {S,N}, Q(Zcr) ^ P0P Q(r<r). More precisely we show the 
following lemma. 

Lemma 4.4.1. Let (I — > r) € -R^, <r a ground substitution, such that lcr,rcr € T{B). 
Then there exists /c, depending on the rule (I — > r), such that Q(r<r) -<£ Q(fcr). 

Proof. Let (7 — > r) and a as in the assumptions of the lemma. We sketch the proof by 
considering the rule: 

PREC p+1 '%, h 1 ,h 2 ](S i (; t), t; n) hi(t,t; n, PREC[<?, fc, /i 2 ](i,t; n)) . 

We abbreviate F := PREC P+1 '% /ti, h 2 ] and set k := 1 + max{3,p + l,g + 1}. Let 
lh(/), / eBbe defined as follows: lh(/) := 1, for / € O, £/, P}. lh(SUB[/, g, h]) := 

i+ih(/)+ih(< 7l ) + ---+ih( 9fc o+ih(/n) + ---+ih(/ l iO. \h(PKEC\aMM) ■■=i+Hg) + 

lh(/ii) + lh(/i2). Then we define the precedence < over £ compatible with lh, i.e. /' < g' 
if lh(/) < lh(g). For Q = S, we employ the following sequence of comparisons: 

S(F(5i(;t),t;n)) 

= (F'(N(^(; t)), N(t!), . . . , N(t p )), S(ni), . . . , S(n g )) 

= J F'(N(5 l (;t)),N(t 1 ),...,N(t p )) 

= J F'(.(5 i )*N(t)),N(t 1 ),...,N(t p )) . 
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By definition S(nj) = () and for each t G T(£,V), t = (i). Moreover it is a direct 
consequence of the definitions that N(Si(;t)) = •(Si) * N(t). Further: 

F'KS^Ni^N^),...,^^)) 

(^(N(t), N(ti), . . . , N(t p )), F'(N(i), N(ti), . . . , N(t p ))) , 

By Definition EH]© we obtain * N(t) ^ fc N(t). This yields by rule IQlffv]) and 
rule I4.3,4 7jv]). using k > p + 1: 

* N(t), N(ti), . . . , N(t p )) ^ fc F'(N(t), N(ti), . . . , N(t p )) . 

Finally applying Definition 14 . 3 . 4K [ITi|) together with rule I4.3.4tjn]) and 14. 3 . 3fjTT|) yields the 
inequality. In these rule applications we employ k > q + 1 and F' > h';. 

(h[(N(t), N(ti), . . . , N(t p )), F'(N(t), N(ti), . . . , N(t p ))) 

= (^(N(t), N(ti), . . . , N(t p ))), S(ni), . . . , S(nO, F'(N(t), N(tx), . . . , N(i p ))) 

= S(^(t,t;n,F(t,t;n))) . 

Finally, it is easy to see that N(F(Sj(; t), t; n)) N(/tj(t, t; n, t; n)). We estab- 
lished the lemma for the rule F(Si(;t),t;n) — > hi(t,t;n,F(t,t;n)). The other rules 
follow similar. 

Note that the definition of k in all cases depends on the arity-information encoded in 
the head function symbol on the left-hand side. Moreover at most 3 iterated applications 
of \Zk are necessary. □ 

The next lemma establish monotonicity for the interpretations S,N. 

Lemma 4.4.2. For k G N and for u,v G T(S), Q(u) -< k Q(v) for Q G {S,N}. Suppose 
/ G B p ' q and t,s G T(E). Then 

- Q(/(ti, . ,* p ;s) -< fc Q(/(ti, . . . ,u, . . .,t p )s) for Q G {S,N}, and 

- Q(f(t; Sl ,...,u,...,s q ) ^ k Q(/(i;si,...,u,...,s 9 )) for Q G {S,N}. 

We define the derivation length function Dip, over the ground term-set T(S): 

Dl^(m;n) := max{n \3t Q ,...,t n e T(B) (t n <- R r g . . . <- R > g t = /(m;n))} . 

Recall the definition of the derivation tree T Rg . Note that for each t G T(B, V), T R i it) is 
finite. This follows from the fact that R' B is terminating and T R i (t) is finitely branching. 
The latter is shown by well-founded induction on — ■ Let / G B be a fixed predicative 
recursive function symbol. As the derivation tree (/(m;n)) is finite only finitely 
many function symbols occur in T Rg (/(m; n)). This allows to define a finite subset 
F C B, such that all terms occurring in T R i (f (in; n.)) belong to T(F). We define 

fc := 1 + max({3} U {p,q+ l\f p ' q G B occurs in 7> (/(m;n))}) . 

Let R' denote the restriction of R' B to T(F). Then, we have Dl^, (m;n) = Dl^,(m;n). 
From these observations together with Lemma 14.4.11 and 14.4.21 we conclude 
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Lemma 4.4.3. Let s,t G T(F) such that t -> R s. Then S(s) S(i). 

In summary we obtain, by following the pattern of the proof of Thm. I4.3.U 

Theorem 4.4.1. For every / G B, Dl^, (mi, . . . ,m p ;ni, . . . ,n^) is bounded by a mono- 
tone polynomial in the sum of the length of the normal inputs mi, . . . , m p . 

4.5 Conclusion 

The main contribution of this paper is the definition of a path order for FP, denoted 
as ^pop- This path order has the property that for a finite TRS R compatible with 
^pop, the derivation length function Dl^ is bounded by a polynomial in the length of 
the inputs for any defined function symbol / in the signature of R. Moreover ^ PO p is 
complete in the sense that for a function / G FP, there exists a TRS R computing / 
such that such that termination of R follows by -<pop- Another feature of ^ PO p is, that 
its definition is devoid of the separation of normal and safe arguments, present in the 
definition of the predicative recursive functions and therefore in the definition of the 
term-rewriting characterisation R' B . 

We briefly relate our findings to th e notion of the light multiset path order, denoted as 
^lmpoi introduced by Marion in |l09| . It is possible to define a variant of -< PO p — denoted 
as ^popv — such that Theorem 14,3.11 remains true for ^ PO pv when suitably reformulated. 
While Definition 14.3.11 and 14.3.21 are based on an arbitrary signature, the definition of 
-< PO pv assumes that normal and safe arguments are separated as in Section I4.2L It is 
easy to see that -<popvC-<lmpo and this inclusion is strict as -< L mpo proves termination 
of the non- feasible rewrite system Rb, while -<popv clearly does not. On the other hand 
let R be a functional program (i.e. a constructor TRS) computing a number-theoretic 
function /. A termination proof of R via -< LM po guarantees the existence of a polytime 
algorithm for /. However, a termination proof of R via or the introduced path order 
^popv (or ^p p) guarantees that R itself is already a polytime algorithm for /. It seems 
clear to us that the latter property is of more practical value. 
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Abstract 

We study the derivational complexity of rewrite systems 1Z compatible with Knuth- 
Bendix orders (KBOs for short), if the signature of IZ is infinite. We show that the 
known bounds on the derivation height are preserved, if 1Z fulfils some mild conditions. 
This allows us to obtain bounds on the derivational height of non simply terminating 
TRSs. Furthermore, we re-establish the 2-recursive upper-bound on the derivational 
complexity of finite rewrite systems 1Z compatible with KBO. 



5.1 Introduction 

One of the main themes in rewriting is termination. Over the years powerful methods 
have been introduced to establish termination of a given term rewrite system (TRS) 
7Z. Earlier research mainly concentrated on inventing suitable reductio n or ders — for ex- 



ample simplification orders, see Chapter 6, authored by Zantema in 137] — capable of 



proving termination directly. In recent years the emphasis shifted towards transforma- 



tion techniques like the dependency pair method or semantic labelling, see 1371 ]. The 



dependency pair method is easily automatable and lies at the heart of many success- 
ful termination provers like TjT |73l ] or AProVE [5^. Semantic labelling with infinitely 
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labels was conceived to be unsuitable for automation. Hence, only the varian t wit h 



14 



finitely many elements was incorporated (for example in AProVE 58] or TORPA 
Very recently this belief was proven wrong. TPA [93J implements semantic labelling with 
natural numbers, in combination with multiset path orders (MPOs) efficiently. As re- 
marked in [96] a sensible extension of this implementation is the combination of semantic 
labelling with Knuth-Bendix orders (KBOs for short). 

In order to assess the power and weaknesses of different termination techniques it is 
natural to look at the length of derivation sequences, induced by different techniques. 



This program has been suggested in 79J]. The best known result is that for finite rewrite 



systems, MPO induces primitive recursive derivational complexity. This bound is essen- 



tially optimal, see [76j, |77|]. Similar optimal r esult s have been obtained for lexciographic 



path orders (LPOs) and KBOs. Weiermann 1451 ] showed that LPO induce multiply re- 



cursive derivational complexity. In 1031 ] Lepper showed that for TRSs compatible with 
KBO, the derivational complexity is bounded by the Ackermann function. 

These results not only assess different proof techniques for termination, but consti- 
tute an a priori complexity analysis for term rewrite systems (TRSs for short) provably 
terminating by MPO, LPO or KBO. The application of termination provers as basis for 
the termination analysis of logic or functional programs is currently a very hot topic. 
Applicability of an a priori complexity analysis for TRSs in this direction seems likely. 

While the aforementioned program has spawned a number of impressive results, not 
much is known about the derivational complexity induced by the dependency pair 
method or semantic labelling (for fixed base orders, obviously). We indicate the sit- 
uation with an example. 

Example 5.1.1. Consider the TRS {J-,1Z) |16f] consisting of the following rewrite rules: 

f(h(x)) - f(i(x)) h(a) - b 

g{i{x)) -»• g{h{x)) i(o) ->• 6 . 

It is not difficult to see that termination of 1Z cannot be established directly with path 
orders or KBOs. On the other hand, termination is easily shown via the dependency pair 
method or via semantic labelling. For the sake of the argument we show termination via 
semantic labelling with KBOs. 

We use natural numbers as semantics and as labels. As interpretation for the function 
symbols we use = &n = 9n{n) = /n(") = 1, i^(n) = n, and hj$(n) = n + 1. The 
resulting algebra (N, >) is a quasi-model for 1Z. It suffices to label the symbol /. We 
define the labelling function if. N — > N as £f(n) = n. Replacing 



f(h(x)) - /(;(*)) 



by the infinitely many rules 



f n+ i(h(x)) -> f n (i(x)) , 

we obtain the labelled TRS, (Ti^b, 7^-iab)- Further the TRS (.Fi a b,£>ec) consists of all 
rules 

fn+l{x) -> f n (x) ■ 
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Now we can show termination of 1Z! := TZi^ U Dec by an instance >~kbo of KBO. We set 
the weight for all occurring function symbols to 1. Further, the precedence is defined as 



fn+i >-f n >-■■■>- k^i>~h>-g>-a>-b. 



It is easy to see that 1Z' Q^kbo- Thus termination of 1Z is guaranteed. 

As the rewrite system 1Z' is infinite we cannot directly apply the aforementioned r esult 



on the derivational complexity induced by Knuth-Bendix orders. A careful study of [1031 ] 
reveals that the crucial problem is not that 1Z' is infinite, but that the signature 
is infinite, as Lepper's proof makes explicit use of the finiteness of the signature: To 
establish an upper-bound on the derivational complexity of a TRS 1Z, compatible with 
KBO, an interpretation function X is d efined, where the cardinality of the underlying 



signature is hard-coded into I, cf. 1031 ] 



We study the situation by giving an alternative proof of Lepper's result compare 1031 ]. 
The outcome of this study is that the assumption of finiteness of the rewrite system can 
be weakened. By enforcing conditions that are still weak enough to treat interesting 
rewrite systems, we show that for (possibly infinite) TRSs 1Z over infinite signatures, 
compatible with KBO, the derivation height of 1Z can be bounded by the Ackermann 
function. Using an example that stems from [T6f] we show that this upper-bound is 
essentially optimal. 

Specialised to Example I5.1.1[ our results provide an upper bound on the derivation 
height function with respect to 1Z: For every t £ T{^F) there exists a constant c (de- 
pending only on t, 1Z', and I^kbo) such that the derivation height dh^(t) with respect 
to 1Z is < Ack(c™,0). As the constant c can be made precise, the method is capable of 
automation. 

This paper is organised as follows: In Section f5 . 2 1 and [5\3l some basic facts on rewriting, 
set theory and KBOs are recalled. In Section[5]4]we define an embedding from ^kbo into 
> lex , the lexicographic comparison of sequences of natural numbers. This embedding 
renders an alternative description of the derivation height of a term, based on the partial 
order > lex . This description is discussed in Section 15.51 and linked to the Ackermann 
function in Section 15.61 The above mentioned central result is contained in Section 15.71 
Moreover in Section [5.71 we apply our result to a non simply terminating TRS, whose 
derivational complexity cannot be primitive recursively bounded. 



5.2 Preliminaries 

We assume familiarity with term rewriting. For further details see [1371 ]. Let V denote 
a countably infinite set of variables and J- a signature. We assume that T contains at 
least one constant. The set of terms over T and V is denoted as T(J-,V), while the 
set of ground terms is written as T{J-). The set of variables occurring in a term t is 
denoted as Var(i). The set of function symbols occurring in t is denoted as FS(i). The 
size of a term t, written as Size(t), is the number of variables and functions symbols in 
it. The number of occurrences of a symbol a £ T U V in t is denoted as |i| a . A TRS 
{J-, TZ) over T(J-, V) is a set of rewrite rules. The smallest rewrite relation that contains 
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1Z is denoted as — The transitive closure of — >n is denoted by — >-i , and its transitive 
and reflexive closure by — A TRS (J-,1Z) is called terminating if there is no infinite 
rewrite sequence. As usual, we frequently drop the reference to the signature T '. 

A partial order y is an irreflexive and transitive relation. The converse of >~ is written 
as -<. A partial order >- on a set A is well-founded if there exists no infinite descending 
sequence a\ y 02 >- • • ■ of elements of A. A rewrite relation that is also a partial order 
is called rewrite order. A well-founded rewrite order is called reduction order. A TRS 
1Z and a partial order >- are compatible if 1Z Qy. We also say that 1Z is compatible with 
y or vice versa. A TRS 1Z is terminating iff it is compatible with a reduction order >-. 

Let (A, >) denote a well-founded weakly monotone jF-algebra. (A, >) consists of a 
carrier A, interpretations fj± for each function symbol in and a well-founded partial 
order > on A such that every is weakly monotone in all arguments. We define a 
quasi-order s t if for all assignments a: V — > A [aj^s) ^ [a]^(<). Here ^ 
denotes the reflexive closure of >. The algebra (A, >) is a quasi-model of a TRS 1Z, if 

A labelling £ for „4 consists of a set of labels L f together with mappings £ / : ^4™ — » Lf 
for every / G T, f n-ary. A labelling is called weakly monotone if all labelling functions 
£f are weakly monotone in all arguments. The labelled signature consists of n-ary 
functions symbols f a for every / € J 7 , a £ Lf, together with all / € T , such that Lf = 0. 
The TRS Dec consists of all rules 

fa+l O^l; • • • ) x n) > fa{x\ 1 ■ ■ ■ 1 %n) > 

for all f E J-. The Xj denote pairwise different variables. Our definition of Dec is 
motivated by a similar definition in [96]. Note that the rewrite relation — >^ ec is not 
changed by this modification of Dec. For every assignment a, we inductively define a 
mapping lab Q : T(T,V) T(Ji ab , V): 



lab Q (t) := 



t if t € V , 

f{\ab a {ti), \ab a (t n )) if t = f(t 1} ...,t n ) and L f 
k /o(lab a (ti), . . . , lab a (i n )) otherwise . 



The label a in the last case is defined as I f ([ct]j[(ti) , . . . , [ct]^(t n )). The labelled TRS 
7?.i a b over .Fi a b is defined as 

{lab a (Z) — » lab a (r) | Z — > r € 72- and a an assignment} . 

Theorem 5.2.1 (Zantema |l50l |). Let 1Z be a TRS, (.A, >) a well-founded weakly mono- 
tone quasi- model for 1Z, and £ a weakly monotone labelling for (A,>). Then 1Z is 
terminating iff 7£i a b U 7J?ec is terminating. 

The proof of the theorem uses the following lemma. 

Lemma 5.2.1. Let 7Z be a TRS, (A, >) a quasi-model of 7£, and £ a weakly monotone 
labelling for (A, >). If s — t, then lab a (s) — >^ ec ■ — >7e lab lab a (i) for all assignments a. 
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5.3 The Knuth Bendix Orders 



We briefly review a few basic concepts from set-theory in particular ordinals, see 85]. 
We write > to denote the well-ordering of ordinals. Any ordinal a^O, smaller than eo, 
can uniquely be represented by its Cantor Normal Form (CNF for short) 

uj ai ni + . . . uj ak rik with a\ > ■ ■ ■ > ■ 

To each well-founded partial order >- on a set A we can associate a (set-theoretic) 
ordinal, its order type. First we associate an ordinal to each element a of A by setting 
otype > (a) := sup{otypey(b) + 1: b € A and b y a}. The order type of denoted by 
otype(y), is the supremum of otype^(a) + 1 with a £ A. For two partial orders y and 
y' on A and A', respectively, a mapping o: A — > A' embeds y into y' if for all p,q £ A, 
p y q implies o(p) y' o(q). Such a mapping is an order-isomorphism if it is bijective and 
the partial orders >- and y' are linear . 



5.3 The Knuth Bendix Orders 

A weight function for T is a pair (w, wq) consisting of a function w : T — > N and a minimal 
weight wo G N, wjo > such that w(c) > wq if c is a constant. A weight function (w, too) 
is called admissible for a precedence >- if / >- g for all g £ .F different from /, when 
/ is unary with w(/) = 0. The function symbol / (if present) is called special. The 
weight of a term t, denoted as w(t) is defined inductively. Assume t is a variable, then 
set w(t) := ^o, otherwise if t = . . . , t n ), we define w(i) := w(g) + w(ti) + • • •+ wft a ) . 



The following definition of KBO is tailored to our purposes. It is taken from [1031 ] . 
We write s = f a s' if s = f a (s') and the root symbol of s' is distinct from the special 
symbol /. Let y be a precedence. The rank of a function symbol is defined as: rk(/) := 
max{rk(g) + 1 | / >- g}. (To assert well-definedness we stipulate max(0) = 0.) 

Definition 5.3.1. Let (w,wq) denote an admissible weight function for T and let >- 

denote a precedence on J- . We write / for the special symbol. The Knuth Bendix order 
^kbo2 on T(J r , V) is inductively defined as follows: s ^kbo2 t if \s\ x > |*|x f° r all x € V 
and 

(i) w(s) > w(t), or 

(ii) w(s) = w(t), s = /V, t = / 6 i', where s' = ^(si, . . . , s n ), t' = h(ti, t m ), and 
one of the following cases holds. 

a) a > b, or 

b) a = b and g >- h, or 

c) a = b, g = h, and (s x , ... ,s„) ^j^ o2 • • • ,*n)> 



Let ^kbo denote the K BO on terms in its usual definition, see 137]. The following 



lemma, taken from [1031 ]. states that both orders are interchangeable. 
Lemma 5.3.1 (Lepper |l03l ]). The orders ^kbo and ^ KB o2 coincide. 
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5 Derivational Complexity of Knuth-Bendix Orders revisited 



In the liter ature real-valued KBOs and oth er g eneralisations of KBOs are studied as 
well, cf. 112 . |45(|. However, as established in |97| any TRS shown to be terminating by 
a real-valued KBO can be shown to be terminating by a integer-valued KBO. 



5.4 Exploiting the Order- Type of KBOs 

We write N* to denote the set of finite sequences of natural numbers. Let p £ N*, we 
write \p\ for the length of p, i.e. the number of positions in the sequence p. The i th element 
of the sequence a is denoted as (p)i-i- We write p ^ q to denote the concatenation of 
the sequences p and q. The next definition is standard but included here, for sake of 
completeness. 

Definition 5.4.1. We define the lexicographic order on N*. If p, q G N*, then p > lcx q 
if, 

- \p\ > \q\, or 

\p\ = \q\ = n an d there exists i G [0, n — 1], such that for all j G [0, % — 1] (p)j = (q)j 
and (p)i > (q)i. 



It is not difficult to see that otype(>^ cx ) = ui w , moreover in 103 ] it is shown that 
otype(^kbo) = k>" '■ Hence otype(> lex ) = otype(^^ ), a fact we exploit below. However, 
to make this work, we have to restrict our attention to signatures T with bounded arities. 
The maximal arity of J- is denoted as Ar(.F). 

Definition 5.4.2. Let the signature T and a weight function (w, wq) for T be fixed. 
We define an embedding tw: T(T, V) -» N*. Set b := max{Ar(.F), 3} + 1. 



tw(t) : = 



(w ,a,0)-0 m if t = f a x, x G V , 

(w(t), a, rk( 5 )) -tw(ti) - • • • -tw(t„) -0 m if t = f a g{h,. ..,t n ) 



The number m is set suitably, so that |tw(t)| = 6 W (*) +1 . 

The mapping tw flattens a term t by transforming it into a concatenation of triples. 
Each triple holds the weight of the considered subterm r, the number of leading special 
symbols and the rank of the first non-special function symbol of r. In this way all the 
information necessary to compare two terms via ^kbo is expressed as a very simple data 
structure: a list of natural numbers. 

Lemma 5.4.1. tw embeds ^kbo into > lcx : If s ^kbo t, then tw(s) > lcx tw(i). 



Proof. The proof follows the pattern of the proof of Lemma 9 in 103]. 

Firstly, we make sure that the mapping tw is well-defined, i.e., we show that the length 
restriction can be met. We proceed by induction on t; let t = f a t'. We consider two 
cases (i) t' G V or (ii) t! = g(t%, . . . ,t n ). Suppose the former: 

|(^o,«,0)| = 3<6 w W +1 . 
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5.5 Derivation Height of Knuth-Bendix Orders 



Now suppose case (ii): Let j = rk(g), we obtain 

\(w(t), a, j) - tw(ti) ~ • • • -tw(t n ) |=3 + b w ^ +1 + • • • + 6 W ^ +1 

< 3 + n ■ b w{t) < 6 w( ' )+1 . 

Secondly, we show the following, slight generalisation of the lemma: 

s ^kbo * A |tw(s)~r| = |tw(t)-V| tw(s)-r > lcx tw(t)-V . (5.1) 

To prove (15. ip we proceed by induction on s ^kbo t. Set p = tw(s)^r, q = tw(t)^r'. 

Case w(s) > w(i): By definition of the mapping tw, we have: If w(s) > w(i), then 
(tw(s)) > (tw(*))o- Thus p > lcx 9 follows. 

Case w(s) = w(t): We only consider the sub-case where s = f a g(si, . . . , s n ) and t = 
f a g(ti, . . . , t n ) and there exists i £ [1, n] such that sj = ti, . . . , Sj_i = ti-i, and Sj ^kbo U- 
(The other cases are treated as in the case above.) The induction hypothesis expresses 
that if |tw(sj) | = |tw(ij) ^v'\, then tw(sj) ^ v > lex tw(tj) ^ v'. For j = rk(g), we 
obtain 

w 

, * v 

p = (w(s),o, j)^tw(si)^- • •^tw(s i _i)^tw(s i )^- • -^tw(s n )^r , 
q = (w(s),a, j)^tw(si)^- • • ~tw(si_i) ^tw(^) ^ • • •^-tw(t n )^r / . 



Due to \p\ = \q\, we conclude 

|tw(sj)^- • -^tw(s n )^r| = |tw(tj)^- • • ^tw(i n ) ^r'| . 
Hence induction hypothesis is applicable and we obtain 

tw(sj)^- • • ^tw(s n ) > lcx tw(ij)^- • •^-tw(t n )^r / , 

which yields p > lex q. This completes the proof of (|5,ip . 

Finally, to establish the lemma, we assume s >-kbo £■ By definition either w(s) > w(t) 
or w(s) = w(i). In the latter case tw(s) > lox tw(i) follows by (15. ip . While in the former 
tw(s) > lcx tw(i) follows as w(s) > w(i) implies |tw(s)| > |tw(i)|. □ 

5.5 Derivation Height of Knuth-Bendix Orders 

Let 1Z be a TRS and ^kbo a KBO such that ^kbo is compatible with 1Z. The TRS 7?. and 
the KBO ^kbo are fixed for the remainder of the paper. We want to extract an upper- 
bound on the length of derivations in 1Z. We recall the central definitions. Note that we 
can restrict the definition to the set ground terms. The derivation height function dh^ 
(with respect to 1Z on T{T)) is defined as follows. 

dhft(i) := max({n | 3(t , ...,t n )t = t h . . . t n }) . 
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5 Derivational Complexity of Knuth-Bendix Orders revisited 



We introduce a couple of measure functions for term and sequence complexities, re- 
spectively. The first measure sp : T{? ', V) — > N bounds the maximal nesting of special 
symbols in the term: 



The second and third measure rk: T{J-, V) — > N and mrk: T(^ r , V) — > N collect infor- 
mation on the ranks of non special function symbols occurring: 



The fourth measure max: N* —> N considers sequences p and bounds the maximal 
number occurring in p: 



It is immediate from the definitions that for any term t: sp(t), rk(t), mrk(i) < max(tw(t)). 
We write r < t to denote the fact that r is a subterm of t. 

Lemma 5.5.1. If r < t, then max(tw(i)) > max(tw(r)). 

We informally argue for the correctness of the lemma. Suppose r is a subterm of t. 
Then clearly w(r) < w(t). The maximal occurring nesting of special symbols in r is 
smaller (or equal) than in t. And the maximal rank of a symbol in r is smaller (or equal) 
than in t. The mapping tw transforms r to a sequence p whose coefficients are less than 
w(t), less than the maximal nesting of special symbols and less than the maximal rank 
of non-special function symbol in r . Hence max(tw(i)) > max(tw(r)) holds. 

Lemma 5.5.2. If p = tw(i) and q = tw(/ a t), then max(p) + a > max(g). 

Proof. The proof of the lemma proceeds by a case distinction on i. □ 

Lemma 5.5.3. We write m — n to denote max({m — n, 0}). Assume s ^kbo t with 
sp{t) < K and (mrk(i) — rk(s)) < K. Let a be a substitution and set p = tw(sa), 
q = tw(tcr). Then p > lcx q and max(p) + K > max(g). 

Proof. It suffices to show max(p) + K > max(g) as p > lcx q follows from Lemma I5.4.H 
We proceed by induction on t; let t = f a t'. 

Case t' G V: Set t' = x. We consider two sub-cases: Either (i) xa = f b y, y € V or (ii) 
xcr = f b g(u\, . . . ,u m ). It suffices to consider sub-case (ii), as sub-case (i) is treated in 




a if t = f a x, x £ V , 

max({a} U {sp(^) | j € [l,n]}) if t = / a 5 (ti, . . . , t n ) . 





max(p) 



max({(p) i | i € [0, |p| - 1]}) . 
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5.5 Derivation Height of Knuth-Bendix Orders 



a similar way. From s ^kbo we know that for all y G V, |s|y > hence x G Var(s) 
and xcj < so~. Let Z := rk(g); by Lemma l5.5.1l we conclude max(tw(xcr)) < max(p). I.e. 
b, Z, max(tw(ui)), . . . , max(tw(u m )) < max(p). We obtain 

max(g) = max({wo, a + 6, 1} U {max(tw(u,)) | i G [1, m]}) 

< max({w(s<r), sp(t) + max(p), max(p)} U {max(p)}) 

< max({w(scr), max(p) + i<C} U {max(p)}) = max(p) + i<C . 

Case t' = g(t\, . . . , t n ): Let j = rk(g). By Definition 15 . 3 . 1 1 we obtain s ^kbo U- Moreover 
sp(£j) < sp(i) < If and mrk(ij) < mrk(i). Hence for all i: sp(U) < K and (mrk(tj) — 
r k( s )) < K holds. Thus induction hypothesis is applicable: For all i: max(tw(ijcr)) < 
max(p) + K. By using the assumption (mrk(t) — rk(s)) < K we obtain: 

max(g) = max({w(fcr), a, j} U {max(tw(ijcr)) | i G [l,n]}) 

< max({w(ta), sp(i), rk(s) + K} U {max(p) + K}) 

< max({w(sa), sp(t), rk(scr) + if} U {max(p) + IT}) 

< max({w(sa"), X, max(p) + if} U {max(p) + K}) = max(p) + K . 

□ 

In the following, we assume that the set 

M := {sp(r) I^r£^}U {(mrk(r) ^ rk(Z)) [ Z -> r G ft} (5.2) 

is finite. We set if := max(M) and let if be fixed for the remainder. 

Example 5.5.1. With respect to the TRS VJ := 7£i a b U Dec from Example 15.1.11 we 
have M = {(mrk(r) — rk(Z)) | Z — > r G 72.'}. Note that the signature of 1Z' doesn't contain 
a special symbol. 

Clearly M is finite and it is easy to see that max(M) = 1. Exemplary we consider 
the rule schemata f n +i(h(x)) — ► f n (i(x)). Note that the rank of i equals 4, the rank 
of h is 3, and the rank of /„ is given by n + 5. Hence mrk(/ n (i(rc))) = n + 5 and 
rk(/ n+ i(/i(x))) = n + 6. Clearly (n + 5 - n + 6) < 1. 

Lemma 5.5.4. If s — t, p = tw(s), g = tw(i), then p > lox g and «(max(p), if) > 
max(g), where u denotes a monotone polynomial such that u(n,m) >2n + m. 

Proof. By definition of the rewrite relation there exists a context C, a substitution a and 
a rule I ^ r £ R such that s = C[la] and i = C[m]. We prove max(g) < u(max(p), if) 
by induction on C. Note that C can only have the form (i) C = /"[□] or (ii) C = 
f a g(u u ...,C'[a},...,u n ). 

Case C = /*[□]: By Lemma [5.5.31 we see max(tw(rc)) < max (tw (la) ) + if . Employing 
in addition Lemma 15.5.21 and Lemma 15. 5.1} we obtain: 

max(g) = max(tw(/ a ro")) < max(tw(rcr)) + a 

< max(tw(Z<r)) + if + a 

< max(p) + if + max(p) < u(max(p), if) . 
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5 Derivational Complexity of Knuth-Bendix Orders revisited 



Case C = f a g{ui, . . . , C'[D], . . . ,u n ): As C'[la] C'[ra], induction hypothesis is 
applicable: Let p' = tw(C"[icr]), q' = tw(C"[r<r]). Then max(g') < <u(max(p'), K). For 
rk(g) = I, we obtain by application of induction hypothesis and Lemma f5. 5. II 

max(g) = max({w(i), a, 1} U {max(tw(«i)), . . . , max(g), . . . , max(tw(w n ))}) 

< max({w(s), a, 1} U 

U{max(tw(ui)), . . . , !i(max(p'), K), . . . , max(tw(u n ))}) 

< max({w(s), a, 1} U {max(p), u(max(p), K)}) = u(max(p), K) . 

□ 

We define approximations of the partial order > lex . 

P >n X 9 iff P > lcx 1 and u(max(p),n) > max(g) , 

where u is defined as in Lemma 15.5.41 Now Lemma 15.5.31 can be concisely expressed as 
follows, for K as above. 

Proposition 5.5.1. If s — >k t, then tw(s) >^- x tw(t). 

In the spirit of the definition of derivation height, we define a family of functions 
Ah n : N — > N: 

Ah n (p) := max({m | 3{p , ...,p m )p = p >J, CX pi >^ ox • • • >J, 0X p m }) ■ 

The following proposition is an easy consequence of the definitions and Proposi- 
tion E5J] 

Theorem 5.5.1. Let {F,1Z) be a TRS, compatible with KBO. Assume the set M := 
{sp(r) | I r G 1Z} U {(mrk(r) — rk(Z)) | / — > r G 1Z} is finite and the arities in of the 
symbols in J- are bounded; set K := max(M). Then dh-fc(t) < Ahii-(tw(t)). 

In the next section we show that Ah n is bounded by the Ackermann function Ack. 
Thus providing the sought upper-bound on the derivation height of 1Z. 



5.6 Bounding the Growth of Ah Tl 

Instead of directly relating the function s Ah n to the Ackermann function, we make use 
of the fast-growing Hardy functions, cf. |l28| |. The Hardy functions form a hierarchy of 
unary functions H a : N — > N indexed by ordinals. We will only be interested in a small 
part of this hierarchy, namely in the set of functions {H Q | a < uj^}. 

Definition 5.6.1. We define the embedding o: N* — > lo u as follows: 

o(p) := uj^ l (p) + ... u(p)e-2 + (p)l-l , 

where t = \p\. 
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The next lemma follows directly from the definitions. 

Lemma 5.6.1. If p > lcx q, then o(p) > o(q). 

We associate with every a < co^ in CNF an ordinal a n , where n G N. The sequence 
(a n ) n is called fundamental seq uenc e of a. (For the connection between rewriting and 
fundamental sequences see e.g. |l!9| or Chapter [3l) 

0, 

(3 + uj^ +1 ■ k . 

Based on the definition of a n , we define H a : N — > N, for a < uj u by transfinite 
induction on a: 

H (n):=n H a (n) := H a „(n + 1) . 

Let >( n ) denote the transitive closure of (.)„, i.e. a >( n ) iff ctn >(n) (3 or a n = f3. 
Suppose a,j3 < uj u . Let a = a; ai ni + . . .uj ak nk and /? = w^mi + . . .u)" l mi. Recall 
that any ordinal a ^ can be uniquely written in CNF, hence we can assume that 
a\ > • • • > oik an d fix > ■ ■ ■ > A- Furthermore by our assumption that a,/3 < u^, we 
have a«,/3j G N. We write NF(a, /3) if a fc > ft. 

Before we proceed in our estimation of the functions Ah n , we state some simple facts 
that help us to calculate with the function H a . 

Lemma 5.6.2. (i) If a >t n ) P> then a >( n +i) (3 + 1 or a = [3 + I. 

(ii) If a >(ri) ft an d n > m, then H a (n) > H ( g(m). 

(iii) If n > m, then H a (n) > H Q (m). 

(iv) If NF(a,/3), then H a+i g(n) = H a o H i g(n); o denotes function composition. 

We relate the Hardy functions with the Ackermann function. The stated upper-bound 
is a gross one, but a more careful estimation is not necessary here. 

Lemma 5.6.3. For n > 1: W^{m) < Ack(2n,m). 

Proof. We recall the definition of the Ackermann function: 

Ack(0, m) = m + 1 
Ack(n + 1,0) = Ack(n, 1) 
Ack(n + l,m + 1) = Ack(ra,Ack(ra + l,m)) 

In the following we sometimes denote the Ackermann function as a unary function, 
indexed by its first argument: Ack(n,m) = Ack n (m). To prove the lemma, we proceed 
by induction on the lexicographic comparison of n and m. We only present the case, 



a. 




7+1 



if a 
if a 

l)+o;T-(n+l) if a 
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where n and m are greater than 0. As preparation note that m + 1 < H w n(m) holds for 
any n and Ack^(m + 1) < Ack n _|_i(m + 1) holds for any n, m. 



H^n+i (m + 1) = H w n (m+2) (m + 2) 

= H^ ) „H a; n( m+1 )(m + 1) 

< Ack| n Ack 2 ( n+ i)(m) 

< Ack 2n +iAck 2 ( n+ i) (m) 
= Ack(2(n + l),m + 1) 



Lemma 15.6. 2t|iiiliv|) 
Lemma I5.6.2[p v]) 

induction hypothesis 



Lemma 5.6.4. Assume u(m, n) < 2m + n and set £ = \p\. For all n € N: 
Ah n (p) < H w 3. ( p )(u(max(p),n) + 1) < H w 4 +( (max(p) + n) . 
Proof. To prove the first half of (|5.3p , we make use of the following fact: 

p > lcx q A n > max(g) o(p) >( n) o(g) . 



□ 



(5.3) 



(5.4) 



To prove (|5.4p . one proceeds by induction on > lex and uses that the embedding o: N* — > 
cj w is essentially an order-isomorphism. We omit the details. 

By definition, we have Ah n (p) = max({Ah„(g) + 1 | p > l £ x q}). Hence it suffices to 
prove 

p > lcx q A u(max(p), n) > max(q) Ah n (g) < H u 2. ( p )(ii(max(p) l n) + 1) (5.5) 

We fix p fulfilling the assumptions in f)5.5[) : let a = o(p), (3 = o(q), v = ji(max(g),n). 
We use (|5.4p to obtain a >r v ) (3. We proceed by induction on p. 

Consider the case a v = (3. Asp > lcx q, we can employ induction hypothesis to conclude 
Ah n (q) < H u 2. y(w(max(g),n) + 1). It is not difficult to see that for any p e N* and 
n £ N, 4max(p) + 2n + 1 < H u 2(u(max(p),n)). In sum, we obtain: 



Ah n (<?) < H w 2. o{q) {u(max{q),n) + 1) 

< H w a. at( (it(«(max(p),n),n) + 1) 

< H wa . at) (4max(p) + 2n+l) 

< Hu2. a „H w a(«(max(p),n)) 
= Hwa.^+ijCuCmaxCp),)!)) 

< H^a.^+i) («(max(p),n) + 1) 

< H^2. Q (n(max(p),n) + 1) 



max(g) < !/(max(p),n) 
Definition of u 

Lemma I5.6.2[j rv]) 
Lemma !5.6.2l1iTTT ) 
Lemma 15.6.2 flTT|) 
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The application of Lemma I5.6.2t[n|) in the last step is feasible as by definition a > ^ 
a v . An application of Lemma f5 . 6 . 2 K fT|) yields a v + 1 <(„+i) a. From which we deduce 
to 2 ■ (a v + 1) <(„+!) uj 2 ■ a. 

Secondly, consider the case a v >r v ) (3. In this case the proof follows the pattern of 
the above proof, but an additional application of Lemma I5.6.2tj iv|) is required. This 
completes the proof of (|5.5p . 

To prove the second part of (|5.3p . we proceed as follows: The fact that u > o(p) 
is immediate from the definitions. Induction on p reveals that even u >( max (p)) °{p) 
holds. Thus in conjunction with the first part of (15.3H . we obtain: 

Ah n (» < H w 2. o(p) (u(max(p),n) + 1) < H w 2+ ( (u(max(j)) ) n) + 1) 
< H u 4+«(max(p) + n) . 

The last step follows as 2max(p) + n + 1 < H a; 2(max(p) + n). □ 

As a consequence of Lemma 15.6.31 and 15.6.4^ we obtain the following proposition. 

Theorem 5.6.1. For all n > 1: If £ = \p\, then Ah n (p) < Ack(2^ + 8,max(p) + n). 



5.7 Derivation Height of TRSs over Infinite Signatures 
Compatible with KBOs 

Based on Theorem 15.5.11 and 15.6.11 we obtain that the derivation height of t G T^) is 
bounded in the Ackermann function. 

Theorem 5.7.1. Let {F,K) be a TRS, compatible with KBO. Assume the set M := 
{sp(r) [ / — > r G 7£}U{(mrk(r) — rk(Z)) | / — > r G 1Z} is finite and the arities of the symbols 
in T are bounded; set K := max(M). Then dh n (t) < Ack(C(|tw(t)|) + max(tw(t)) + 
K,0). 

Proof. We set u(n, m) = 2n + m and keep the polynomial u fixed for the remainder. 
Let p = tw(t) and £ = \p\. Due to Theorem 15,5. II we conclude that dh^(t) < Ahj^(p). 
It is easy to see that Ack(n,m) < Ack(n + m, 0). Using this fact and Theorem 15.6.11 
we obtain: Ah K (p) < Ack(0(f), max(p) + K) < Ack(0(^) + max(p) + K,0). Thus the 
theorem follows. □ 

For fixed t G T^) we can bound the argument of the Ackermann function in the 
above theorem in terms of the size of t. We define 

r mffl := mrk(t) u> max := max({w(n) [ u G FS(t) U Var(i)} . 

Lemma 5.7.1. For t G T(T\ let r max , w ma _ x be as above. Let b := max{Ar(J r ), 3} + 1, 
and set n := Size(i). Then w(t) < w max • n, sp(t) < n, mrk(t) < r max . Hence |tw(t)| < 
5«j ma x(n)-n+i anc i max (tw(t)) < tf max (n) • n + r max . 

Proof. The proof proceeds by induction on i. □ 
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Corollary 5.7.1. Let (J-,7Z) be a TRS, compatible with a KBO ^kbo- Assume the set 
{sp(r) | I — > r G TV} U {(mrk(r) — rk(/)) | I — ► r G 7£} is finite and the arites of the 
symbols in J 7 are bounded. Then for t G T{T), there exists a constant c — depending on 
t, {J 7 , TV), and ^ kbo — such that dh w (t) < Ack(c n ,0). 

Proof. The corollary is a direct consequence of Theorem 15.7.11 and Lemma 15.7.11 □ 

Remark 5.7.1. Note that it is not straight-forward to apply Theorem 15.7.11 to classify 
the derivational complexity of TZ, over infinite signature, compatible with KBO. This is 
only possible in the (unlikely) case that for every term t the maximal rank mrk(t) and 
the weight w(t) of t can be bounded uniformly, i.e. independent of the size of t. 

We apply Corollary 15.7.11 to the motivating example introduced in Section 15.11 

Example 5.7.1. Recall the definition of TZ and TV := 7£i a b U T>ec from Example 15.1.11 
and I5.5.11 respectively. Let s G Ti^iab) be fixed and set n := Size(s). 

Clearly the arities of the symbols in are bounded. In Example 1 5 . 5 . 1 1 we indicated 
that the set M = {(mrk(r) — rk(Z) ) | I — ► r G TV} is finite. Hence, Corollary 15.7.11 
is applicable to conclude the existence of c G N with dhni(s) < Ack(c n ,0). In order 
to bound the derivation height of TZ, we employ Lemma 15.2.11 to observe that for all 
t G T{T\. dh-ji(t) < dhfci (\ab a (t)) , for arbitrary a. As Size(t) = Size(lab a (t)) the above 
calculation yields 

dh n (t) < dh^(lab Q (t)) < Ack(c n ,0) . 
Note that c depends only on t, TV and the KBO ^kbo employed. 

The main motivation of this work was to provide an alternative proof of Lepper's result 
that the derivational complexity of a ny finite TRS, compatible with KBO, is bounded 
by the Ackermann function, see 1031 ] . We recall the definition of the derivational 



com- 



plexity: 

dc-jiin) := max({dh^(t) | Size(i) < n}) . 

Corollary 5.7.2. Let (J-,1Z) be a TRS, compatible with KBO, such that J- is finite. 
Then dh^(n) < Ack(2 c, ("), 0). 

Proof. As T is finite, the K = max({(mrk(r) — rk(Z)) | I — * r G TV}) and Ar(.F) are obvi- 
ously well-defined. Theorem E7H yields that dh^(t) < Ack(C(|tw(t)|) + max(tw(t)) + 
K, 0). Again due to the finiteness of J-, for any t G mrk(t) and w(t) can be esti- 

mated independent of t. A similar argument calculation as in Lemma 15.7.11 thus yields 
dhn(t) < Ack(2°( Size W), 0). Hence the result follows. □ 



Remark 5.7.2. Note that if we compare the above corollary to Corollary 19 in [1031 ]. 
we see that Lepper could even show that dc-^(n) < Ack(C(n), 0). On the other hand, as 
already remarked above, Lepper's result is not admissible if the signature is infinite. 

In concluding, we want to stress that the method is also applicable to obtain bounds 
on the derivational height of non simply terminating TRSs, a feature only shared by 



Hofbauer's approach to utilise context-dependent interpretations, cf. 781 ] . 
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5. 7 Derivation Height of TRSs over Infinite Signatures Compatible with KBOs 



Example 5.7.2. Consider the TRS consisting of the following rules: 

f(x) o(yoz)-> X o (f 2 {y) o z) a(a(x)) -> a(b(a(x))) 

f(x) o (jj o (z o w)) ->lo(zo(i/o u;)) 
/(x) -> X 

Let us call this TRS 7£ in the following. Due to the rule a(a(x)) — > a(b(a(x))), TZ is not 
simply terminating. And due to the three rules, presented on the left, the derivational 
complexity of TZ cannot be bounded by a primitive recursive function, compare [76| . 

Termination can be shown by semantic labelling, where the natural numbers are used 
as semantics and as labels. The interpretations ajsj(n) = n + 1, b^(n) = max({0, n — 1}), 
fn(n) = n, and m o N n = m + n give rise to a quasi-model. Using the labelling function 
£a(n) = n i termination of TZ' := 7£i a b U Vec can be shown by an instance ^kbo of 
KBO with weight function (w, 1): w(o) = w(/) = 0, w(b) = 1, and w(a n ) = n and 
precedence: / >- o >- . . . a n+ \ >- a n y ■ ■ ■ y ao y b. The symbol / is special. Clearly 
the arities of the symbols in are bounded. Further, it is not difficult to see that 
the set M = {sp(r) I -> r £ TZ'} U {(mrk(r) - rk(/)) | I -» r G TZ'} is finite and 
K := max(M) = 2. 

Proceeding as in Example l5.7.1l we see that for each t G T(T\ there exists a constant 
c (depending on t, TZ' and ^kbo) such that dh-^(t) < Ack(c n ,0). 
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Abstract 

In this paper we introduce a restrictive version of the multiset path order, called polyno- 
mial path order. This recursive path order induces polynomial bounds on the maximal 
number of innermost rewrite steps. This result opens the way to automatically verify 
for a given program, written in an eager functional programming language, that the 
maximal number of evaluation steps starting from any function call is polynomial in the 
input size. To test the feasibility of our approach we have implemented this technique 
and compare its applicability to existing methods. 

6.1 Introduction 

Term rewriting is a conceptually simple but powerful abstract model of computation 
that underlies much of declarative programming. In rewriting, proving termination is an 
important research field. Powerful methods have been introduced to establish termina- 
tion of a given term rewrite system. One of the most natural ways to proof termination 
is the use of interpretations. Consequentially this technique has been introduced quite 
early. Moreover, if one is interested in automatically proving termination, polynomial 
interpretations provide a natural starting point, cf. [431 ]. However, termination proofs via 

1 This research was partially supported by FWF (Austrian Science Fund) project P20133. 
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polynomial interpretations are limited as the longest possible rewrite sequences admitted 
by rewrite systems compatible with a polynomial interpretation are double-exponential 
(in the size of the initial term), see [79(. Another well-studied (and direct) termination 
technique is the use of reduction orders — for example simplification orders. Still this 
technique is li mited , whi ch can again be shown by the analysis of the induced derivation 
length, cf. [77L E44L E53|. In recent years the emphasis shifted towards transformation 



techniques like the dependency pair method or semantic labeling. Transformation tech- 
niques have significantly increased the possibility to automatically prove termination. 

Once we have established termination of a given rewrite system 1Z, it seems natural to 
direct the attention to the analysis of the complexity of 7Z. In rewriting the complexity of 
a rewrite system 1Z is measured as the maximal derivation length with respect to TZ. As 
mentioned above for direct termination methods a significant amount of investigations 
has been conducted, providing a suitable foundation for further research. Unfortunately, 
almost nothing is known about the length of derivations induced by state-of-the-art 
termination techniques like the dependency pair method or semantic labeling. For the 
dependency pair method no results on the induced deriv ation length are known. Partial 
result with respect to semantic labeling are reported in 115l |. 



In this paper we introduce a restriction of the multiset path order, called polynomial 
path order (denoted as > pop *)- Our main result states that this recursive path order 
induces polynomial bounds on the maximal length of innermost rewrite steps. As we 
have successfully implemented this technique, we thus can automatically verify for a 
given term rewrite system TZ that 1Z admits at most polynomial innermost derivation 
length (on the set of constructor-based terms). This opens the way to automatically 
verify for a given program — written in an eager functional programming language — that 
its runtime complexity is polynomial (in the input size). The only restrictions in the 
applicability of the result are that (i) the functional program P is transformable into a 
term rewrite system TZ and (ii) a feasible (i.e., polynomial) derivation length with respect 
to 1Z gives rise to a feasible runtime complexity of P. In short the transformation has to 
be non-termination and complexity preserving. 



The definition of polynomial path orders employs the idea of tiered recursion 21]. 
Syntactically this amount to a separation of arguments into normal and safe argument. 
(Below this will be governed by the presences of mappings safe and nrm associating with 
each function symbol a list of argument positions.) We explain our approach by an 
example rewrite system that clearly admits at most polynomial derivation length. 

Example 6.1.1. Consider the following rewrite system TZ mu \±. 



add(x,0)^x mult(0,y) -> 

add(s(x), y) — > s(add(x, y)) mult(s(x), y) — > add(y, mult(x, y)) 

We suppose that all arguments of the successor (s) are safe (safe(s) = {1}), that the 
second argument of addition (add) is safe (safe(add) = {2}) and that all arguments of 
multiplication (mult) are normal (safe(mult) = 0). Furthermore let the (strict) prece- 
dence > be defined as mult > add > s. Then TZ mu \ t is compatible with > pop * (see 
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Definition I6.3.2j) and as a consequence of our main theorem (see Section I6.3[) we con- 
clude that the number of rewrite steps starting from mult(s n (0), s m (0)) is polynomially 
bounded in n and m. (Here we write s n (0) as abbreviation of s(. . . (s(0) • • • )) with n 
occurrences of the successor symbol s.) 

The polynomial path order is an extension of the path order for FP introduced by Arai 
and the second author in [8J (see also Chapter [3]). A central motivation of this research 
is the observation that the direct application of the latter order is only successful on a 
handful of (very simple) rewrite systems. The path order for FP gains only power if 
additional transformations are performed. Unfortunately, such powerful transformations 
are difficult to find automatically. 

Further note that the polynomial path order is to some extent related to the light 
multiset path order introduced by Marion [109(. Roughly speaking the light multiset 
path order is a tamed version of the multiset path order, characterising the functions 
computable in polytime. It seems important to stress that the below stated main theorem 
fails for the light multiset path order. This can be easily seen from the next example. 

Example 6.1.2. Consider the f ollow ing rewrite system 7Zb m . (This is Example 2.21 
about binomial coefficients from HfJ.) 



bin(x, 0) -> s(0) bin(s(x), s(y)) -> +(bin(x, s(y)), bin (a;, y)) 

bin(0,s(j,)) ^0 

For a precedence that fulfills bin > s, bin > + and separations of arguments safe(bin) = 0, 
saf e(+) = {1,2}, we obtain that lZ^- m is compatible with the light multiset path order, 
cf. E3. However it is straightforward to verify that the (innermost) derivation height 
of bin(s n (0), s m (0)) is exponential in n. 

To test the feasibility of our approach we have implemented a small complexity anal- 
yser based on the polynomial path order and compare its applicability to existing tech- 
niques. To do so, we also have implemented the light multiset path order and a restricted 
form of polynomial interpretations, so-called additive polynomial interpretations, cf. 
Note that compatibility with addivite polynomial interpretations induces polynomial 
derivation length for co nstr uctor-based terms, cf. [26| . 

The research in [26l . 109| falls into the realm of implicit complexity theory. In this 



context related work to our research is due to Bonfante et al. 1 291 but see also seminal 



work by Hofmann [821 ] and Schwichtenberg 134 ], While [82j. 1 1341 ] are incomparable to 



our techniques, a comparison to [29j] is also not straightforward. Our principal concern 
is that the termination techniques employed allow for an complexity analysis of the 
subjected program. On the other hand the crucial feature of quasi-interpretations (the 
central contribution of [29j) is their weak monotonicity, hence termination can only 
be shown in conjunction with other termination techniques. For example the class of 
polytime computable functions can be characterised as the class of functions computable 
by confluent constructor rewrite systems compatible with the multiset path order and 



that admit only additive quasi-interpretations, cf. 29]. This interesting result renders an 
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insightful implicit characterisation of the polytime computable function, but it is of little 
help, if one wants to obtain a complexity analysis of a term rewrite system subjected to a 
modern termination prover. Recently a n in teresting application of quasi-interpretations 
has been reported by Lucas and Peha 108j ]. Here the dependency pair method is used 



in conjunction with quasi-interpretations to obtain bounds on the memory consumption 
of Safe programs. This method is easily automatable, but new ideas are necessary to 
yield bounds on the runtime behaviour of functional programs. 

The remainder of this paper is organised as follows. In the next section we recall basic 
notions and starting points of this paper. In Section 16.31 we have collected our main 
results. In order to prove these results we extend results originally presented in 0j . Our 
findings in this direction are presented in Section 16.41 The central argument to prove 
the main theorem is then given in Section [6.51 In Section [6.61 we give the experimental 
evidence mentioned above. In Section 16.71 we touch upon an application of our main 
theorem in recent work (together with Hirokawa and Middeldorp) where we study the 
termination behaviour of Scheme programs. Finally in Section 16.81 we conclude and 
mention possible future work. 



6.2 Preliminaries 



We assume familiarity with term rewriting la. 1 1371 ] . Let V denote a countably infinite 



set of variables and T a signature. The set of terms over T and V is denoted by T(!F, V). 
We always assume that J- contains at least one constant. The arity of a function symbol 
/ is denoted as ar(/). Let > be a precedence on the signature T. The rank of a function 
symbol is defined inductively as follows: rk(/) = 1 + m&x{rk(g) \ g € J- A / > g}. (Here 
we employ the convention that the maximum of an empty set equals 0.) We write < 
to denote the subterm relation and > for its converse. The strict part of > is denoted 
by >. Var(i) denotes the set of variables occurring in a term t. The size (depth) of 
a term t is denoted as size(i) (dp(i)). The width of a term t is defined inductively as 
follows: wd(t) = 1, if t is a variable or a constant, otherwise if t = f(t\, . . . ,t n ) with 
n > 0, we set w6(t) = max{n, wd(ti), . . . ,wd(i n )}. The Buchholz norm of a term t is 
defined inductively as follows: ||t|| = 1, if t is a variable and for t = f(t\, . . . , t n ) we set 
||i|| = 1 + max{n, pi||, . . . , ||in||}- We write [ti, . . . , t n ] to denote multisets and l±l for the 
summation of multisets. 

A term rewrite system ( TRS for short) 7Z over T(J-, V) is a set of rewrite rules I — > r, 
such that I $l V and Var(Z) D Var(r). (If not mentioned otherwise, we assume 1Z is finite.) 
The root symbols of left-hand sides of rewrite rules are called defined, while all other 
function symbols are called constructors. For a given signature J- the defined symbols 
are denoted as T>, while the constructor symbol are collected in C. The smallest rewrite 
relation that contains 1Z is denoted by — We simply write — > for — >n if 7Z is clear 
from context. Let s and t be terms. If exactly n steps are preformed to contract s to t 
we write s — > n t. A term s E T(T, V) is called a normal form if there is no t £ T(J-, V) 
such that s — ► t. The innermost rewrite relation -^n of a TRS 7Z is defined on terms as 
follows: s -^-ji t if there exist a rewrite rule I — > r € 7Z, a context C, and a substitution a 
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such that s = C[lcr], t = C[ra], and all proper subterms of la are normal forms of TZ. A 
TRS is called confluent if for all s, t\, ti £ T(J-, V) with s — >* t\ and s ^* t2 there exists 
a term t% such that t\ t% and £2 — > * ^3- A TRS is non- overlapping if it has no critical 
pairs, cf. 15]. A TRS 7?- is left-linear if for all rules I — ► r £ 7£, all variables in / occur 
at most once. If 7£ is additionally non-overlapping, then 7Z is called orthogonal. Note 
that every orthogonal TRS is confluent. A constructor TRS is a TRS whose signature 
J 7 can be partitioned into the defined symbols T> and constructor symbols C in such a 
way that the left-hand side of each rule has the form f(s\, . . . , s n ) with f £ T> and for 
all i: Si € T(C, V). A defined function symbol is completely defined if it does not occur 
in any ground term in normal form. A TRS is completely defined if each defined symbol 
is completely defined. An element of T(C, V) is called a value; we set Val(7£) = T(C, V). 
We call a TRS terminating if no infinite rewrite sequence exists. The derivation length 
of a term t with respect to a terminating TRS 1Z and rewrite relation — >n is defined as 
usual: Dl(^^)(s) = maxjra | 3t s — > n t}. We call a term t = f(ti, . . . ,t n ) constructor- 
based if all its arguments t{ are values, i.e., U G T(C, V) for all 1 ^ i ^ n. The set % 
collects all constructor-based terms. 

A proper order is a transitive and irreflexive relation. The reflexive closure of a 
proper order >- is denoted as y = . A proper order >- is well-founded if there is no infinite 
decreasing sequence t\ >- £2 >" *3 " ' ■ A well-founded proper order that is also a rewrite 
relation is called a reduction order. We say a reduction order >- and a TRS 7£ are 
compatible if 7£ C >~. It is well-known that a TRS is terminating if and only if there 
exists a compatible reduction order. 



6.3 Main Result 

In the sequel 1Z denotes a constructor TRS over a (possible variadic) signature T . Let 
> denote a precedence on T such that for all / G P we have for all c £ C: / > c. (Recall 
that T contains at least one constant.) We assume that 1Z is completely defined, i.e., 
ground normal forms and ground values coincide H 

For each n-ary function symbol / G T> of fixed arity, we suppose the existence of 
a mapping safe that associates with / a (possibly empty) list {h, ■ ■ ■ ,i m } with 1 ^ 
i\ < • ■ ■ < i m ^ n. For a mapping safe and a term t = f(t\, . . . ,t n ), safe(/) denotes 
the safe argument positions of t. The argument positions of t not included in safe(/) 
are called normal and are denoted by nrm(/). The mapping safe (nrm) is referred 
to as safe (normal) mapping. We generalise safe (normal) mappings to constructor 
symbols and variadic function symbols as follows: For each function symbol f E C, 
we fix safe(/) = {1, . . . , ar(/)} and for each variadic function symbol /6Pwe assert 
safe(/) = 0. The normalised signature J- n contains a function symbol /" for each / € T. 
If / is of fixed-arity and nrm(/) = . . . , i p }, then ar(/) = p. The normalised signature 
C" is defined accordingly. 

2 The assumption that 1Z is completely defined arises naturally in the context of implicit characterisation 
of complexity classes. We follow this convention to some extent, but show that this restriction is not 
necessary. 
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Definition 6.3.1. Let > be a precedence and safe a safe mapping. We define > p0 p 
inductively as follows: s = f(s\, . . . , s n ) > p0 p t if one of the following alternatives holds: 

(i) / is a constructor and > pop t for some i G {1, . . . , re}, 

(ii) Si >p = op t for some i G nrm(/), or 

(hi) t = g(ti, . . . , t m ) with / G T> and f > g and s > p0 p ti for all 1 ^ i ^ m. 

We write s > pop t (i) if s > pop t follows by application of clause (i) in Dehnition l6,3.11 
A similar notation will be used for the orders defined below. 

Definition 6.3.2. Let > be a precedence and safe a safe mapping. We define the polyno- 
mial path order > pop * (POP* for short) inductively as follows: s = f(si, . . . , s n ) > pop * t 
if one of the following alternatives holds: 

(i) 8 ^po P ti 

(ii) Si > popif t for some i G {1, . . . , re}, 

(iii) t = g(ti, . . . ,t m ), with / G T>, f > g, and the following properties hold: 

- s > pop * U for some in G safe(y) and 

- either s > pop U or s t> tj and i G safe(g) for all i ^ iq, 

(iv) t = f(h, . . .,t m ) and for nrm(/) = . . . ,i p }, safe(/) = {ji,. . .,j q ] the following 
properties hold: 

l^il > ■ ■ ■ ! &ip\ (^pop*)mul ]pii > ■ ■ ■ j tip] j 
[Sj!, ■ ■ ■ , Sj q ] (> pop *)mLil \tjii ■ ■ ■ , tj q ]. 

Here (> pop *)mul denotes the multiset extension of > pop * and recall that for variadic 
function symbols, the set of safe arguments is empty. 

Example 6.3.1. Consider the following TRS 7^i nser t (This is a simplification of an ex- 
ample from [1091 ] . ) 

if (true, x, y) — * x x^O — > true 

if (false, x, y ) — ► y 0^s(x) — > false 

ins(x, nil) — > cons(x,nil) s(x)^s(y) — » x^y 

ins(x, cons(y, ys)) — > if(y^x, cons(x, cons(y, ys)), cons(y, ins(x, ys))) 

We represent lists with the help of the constructors nil and cons. To show compatibility 
with POP*, we assume a precedence >- that fulfills ins >- if, ins >- ^, ins y cons, >- true, 
and y false. Further we define a safe mapping safe as follows: 

safe(s) = {1} safe(if) = {1, 2, 3} safe(ins) = 

safe(cons) = {1, 2} safe(^) = {2} 

It is straightforward to verify that the induced polynomial path order ^ pop * is compatible 

With ^insert- 
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An easy inductive argument shows that if s € \/a\(TZ) and s > pop * t, then t € Va\(lZ). 
Note that > pop * is not a reduction order. Although > pop * is a well-founded proper 
order that is closed under substitutions, the order is not closed under contexts due to 
the restrictive definition of clause |rv] in the above definition. However we still have the 
following theorem, which follows as the multiset path order extends > pop *- 

Theorem 6.3.1. Every TRS TZ that is compatible with > pop * for some well-founded 
precedence > is terminating. 

As normal and safe arguments are distinguisable, we strengthen the notion of runtime 
complexity as follows: 

Rc^(m) = max{DI(- K) _L^.)(t) | t = f(ti, . . . ,t n ) G T b and s\ze(U) < m} . 

ienrm(/) 

This function is called the normal runtime complexity. 

Main Theorem. Let TZ be a finite, completely defined constructor TRS. Assume further 
TZ is compatible with > pop *, i.e., 1Z C > pop *. Then the induced (normal) runtime 
complexity is polynomial. 

Assume 1Z is a finite, constructor TRS that is not completely defined; i.e., at least 
one defined function symbol occurs in a ground normal form. To obtain a completely 
defined TRS it suffices to add suitable rules, thus we arrive at the following corollary, 

see 



12] for the proof. 



Corollary 6.3.1. Let 1Z be a finite, constructor TRS. Assume further 1Z is compat- 
ible with > pop *, i.e., TZ C > pop *. Then the induced (normal) runtime complexity is 
polynomial. 

Definition 6.3.3. The predicative rewrite relation s t is defined as follows: s t 
if s — * t by contracting safe argument positions first, i.e., if there exist a rewrite rule 
I — > r € TZ, a context C, and a substitution a such that s = C[lo~], t = C[ra] and all safe 
argument position of la are in normal form. 

Clearly predicative rewriting is a generalisation of innermost rewriting. Essentially 
following the pattern of the proof of the theorem, we arrive at the following corollary. 

Corollary 6.3.2. Let TZ be a finite constructor TRS. Assume further TZ is compatible 
with > pop *, i.e., TZ C > pop *. Then for all / 6 J 7 of arity n, with nrm(/) = . . . ,i p } 
and for all values s\, . . . , s n : Dl^_e^(/(si, . . . , s n )) is bounded by a polynomial in the 
sum of the sizes of the normal argument terms , . . . , Sj p . 

Remark 6.3.1. Beckmann and Weiermann observed in [19( that general rewriting is too 
powerful to serve as a suitable computation model to characterise the class of polytime 
computable functions as a TRS. Their notion of a feasible rewrite system is reflected 
adequately in the notion of predicative rewriting. 
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6.4 Polynomial Path Order on Sequences 

In this section we extend definitions and results originally presented in [§] (see also 
Chapter U]) . The main aim is to define a polynomial path order ► on sequences of terms 
such that ► induces polynomial derivation length with respect to a compatible TRS 1Z. 

Let £ be a variadic function symbol. We extend the normalised signature J- n 
by and define 5eg(J rn , V) = T(J rn U {©}, V). Elements of Seq(!F n ^ V) are sometimes 
referred to as sequences. Instead of 0(si, . . . , s n ), we usually write (si • • ■ s n ) and denote 
the empty sequence () as 0. Let a = (a\...a n ) and b = (b\ . . . b m ) be elements of 
Seq(F n , V). For a / and b / define a @ b = (ai . . . a n h . . . b m ). If o = (6 = 0) 
we set a @ 6 = 6 (a @ b = a). 

Let > denote the precedence on T n induced by the total precedence > on T . Buch- 



holz 30(] was the first to observe that finite term rewrite systems compatible with recur- 
sive path orders y are even compatible to finite approximations of >-. This observation 
carries over to polynomial path orders. The following definitions generalise the path 
order on FP (POP for short) as defined in 0]. To keep this exposition short, we only 
state the definition of approximations of the polynomial path order ► on sequences. The 
general definitions for > and ► is obtained by dropping the restrictions on depth and 



width, cf. [12|]. Note that ► can be conceived as the limit of the finite approximations 
►fc. We use the convention that / € J 7 ", i.e., s = /(si, . . . , s n ) implicitly indicates that 

Definition 6.4.1. Let k,l ^ 1 and let > be a precedence. We define > l k inductively as 
follows: s > l k t for s = f(s\, . . . , s n ) or s = (s\ ■ ■ ■ s n ) if one of the following alternatives 
holds: 

(i) Si (> = )fc t for some i € {1, . . . , n}, 

(ii) s = f(s\, . . . , s n ) such that of the following two possibilities holds: 

- t = g(ti ,...,t m ) with / > g or 

- t — (t\ • • • t m ) j 

and s ti for all 1 ^ i ^ m, and m < k + wd(s), or 

(iii) s = (si • • • s n ), t = (ti ■ ■ ■ t m ) and the following properties hold: 

- [h,...,t m ] =Ni\H---\HN n , 

- there exists i £ {1, . . . , n} such that [s{] ^ N{, 

- for all 1 ^ i ^ n such that [sj] ^ Ni we have Si > l k r for all r € iVj 

- m < /c + wd(s). 

We write to abbreviate > k . 

Definition 6.4.2. Let k,l ^ 1 and let > be a precedence. We define the approximation 
of the polynomial path order on sequences inductively as follows: s t for s = 
f(si, . . . , s n ) or s = (si ■ ■ ■ s n ) if one of the following alternatives holds: 
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(i) a >{ t, 

(ii) Si (► = )fc t for some i G {1, . . . , n}, 

(iii) s = /(si, . . . , s n ), t = (t\ ■ ■ ■ t m ), and the following properties hold: 

- s ►£~ 1 t io for some i G {1, . . . , n}, 

- s > fe _1 i« for all i ^ iq, and 

- m < k + wd(s), 

(iv) s = /(si, . . . ,a n ), i = /(ii, . . . ,i m ) with (si • • ■ s n ) (ii ■ ■■t m ), or 

(v) s = (si ■ • • s n ), i = (ti • • • i m ) and the following properties hold: 

- [h,...,t m ] =NiW---UN n , 

- there exists i G {1, . . . , n} such that [sj 7^ iV*, 

- for all 1 ^ i ^ n such that [a,] 7^ Nf. Si >i r for all r G iVj, and 

- m < fc + wd(s). 

We write ►& to abbreviate ►£. 

Note that is the minimal element of >k and ►& and that ► is a reduction order. 
The following lemmas are direct consequences of the definitions. 

Lemma 6.4.1. 

(i) If s ►fe t and k < I, then s ►z i. 

(ii) If s ►fc t, then C[s] ►& C[i], where C[D] denotes a context over Seq(T n , V). 

Lemma 6.4.2. If s i, then dp(i) ^ dp(s) + I and wd(i) < + wd(s). Moreover, if 
s ►j, t, then ||t|| ^ ||s|| +k + l. 

By Lemma [6321 there exists a (uniform) constant c such that ||i|| ^ ||s|| +c, whenever 
s ►& i. And thus if we have a ►^-descending sequence s = to ►fc ^i ►fc ' ' ' ►fc ^ we 

conclude that [|tj|| ^ ci + ||s|| for all i ^ 1. 

Definition 6.4.3. We define 

Gjfc(s) := max{^ G N [ 3{t Q , . . . ,ti): s = t ►*, h ►& • • • ►*. ^} 

Ffc, p (m) := max{G fc (/(ti, . . . , t n )) : rk(/) =pA^ G fc (*i) < m} 

j 

In the definition of F^p, we assume / G T n . 

A direct consequence of Definition 16.4.31 is that Gfc((ii • • • tn)) = n + Y^i=i holds. 
The following lemma is generalisation of a similar lemma in [8| and the proof given in 0] 
can be easily adapted. 
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Lemma 6.4.3. We define d^fi := k + 1 and dfc )P +i ■= (dk, P ) k + 1- Then for all k,p 
there exists a constant c (depending only on k and p) such that for all m: Fk,p( m ) ^ 
c(m + 2) dfc .p. 

As a consequence of Lemma 16,4.31 we obtain that Fk,p( m ) 1S asymptotically bounded 
by m dk <p for large enough m. The following lemma follows by a standard inductive 
argument. 

Lemma 6.4.4. For all k, there exists a constant c such that for s G T(C n U {©},V): 
Gfc(s) < c • size(s) 2 . 

We arrive at the main theorem of this section. 

Theorem 6.4.1. For all / G T n of arity n, for all si,...,s n G T(C n U {©}), and for 
all /c: Gfc(/(si, . . . , s n )) is bounded by a polynomial in the sum of the sizes of s±, . . . , s n . 
The polynomial depends only on k and the rank of /. 

Proof. Let / G T n and let s 1: . . . , s n G T (C n U {©}). By Lemma EX1 there exists ci G N 
depending on and rk(/) such that 

G fc (/( Sl ,...,s„)) ^m cl (6.1) 

if ^i^/c^i) ^ and m is large enough. By Lemma 16.4.41 there exists a constant c<i 
(depending on the rank of the function symbols in Sj) such that Gfc(sj) C2 • size(s,) 2 . 
Replacing m in (|6.ip by C2 • Q2i size(sj)) 2 and setting c = c^ 1 yields: 

G fe (/( Sl , . . . , s n )) < [c 2 • (^ size( Sj )) 2 ] Cl =c(X; size( S?; )) 2ci 

i i 

□ 



6.5 Predicative Interpretation 

The purpose of this section is to prove our main theorem. Let 7Z denote a completely 
defined, constructor TRS. We embed the order > pop * into such that k depends 
only on 1Z. This becomes possible if we represent the information on normal and safe 
arguments underlying the definition of > p0 p* explicitly by interpreting the signature T 
in the normalised signature J 7 ". 

Let t be a term and recall that ||t|| denotes its (Buchholz) norm. We represent the norm 
unary. Let s denote a fresh miliary function symbol that is minimal in the precedence > 
on JF n . We define BN(t) = U(||t||), where U : N — > 7~({s, o}) denotes the representation of 
n as a sequence (s • • • s) with n occurrences of the constant s. As a direct consequence 
of the definition, we have: s > t implies BN(s) BN(t) for any k. 
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Definition 6.5.1. Let safe denote a safe mapping. A predicative interpretation (with re- 
spect to T(T, V)) is a pair (S, N) of mappings S : T(F, V) -► T{F",V) and N : T(T, V) -> 
T{T n , V), denned as follows: 



S(t) 



ifiGVal(72) 
(/ n (N( Sil ),...,N( Sip ))S( Sil ) ...S( Si J) iftgVal(tt) 
N(t) = (S(i)) @ BN(t) 



In the definition of S, we assume i = f(si, . . . , s n ), nrm(/) = {ji, . . . ,j p } and safe(/) = 
{il, . . . , i q }. (Recall that safe(/) U nrm(/) = {1, . . . , n}.) 

Note that N(s) >k S(s) (and thus N(s) S(s)) holds for any fe. Moreover, observe 
that for any term t, we have wd(N(t)) = 1 + \\t\\ which follows by a simple inductive 
argument. We arrive at the two main lemmas of this section. 

Lemma 6.5.1. Let f(l\, . . . , l n ) — ► r G 72., let a: V — > Val(72.) be a substitution and let 
fc = 2 • max{size(r) | Z — ► r G 72.}. If f(h, ...,/„) > pop r then f n (H(l h a), . . . , N(i^ff)) > fc 
Q(ra) for Q € {S, N}, where nrm(/) = {i\, . . . , i p }. 

Proof. We sketch the proof plan: Instead of showing the lemma directly, one shows the 
following stronger property for terms s,i£ V) where s is either a value or of form 
/(si, . . . , s n ) such that SjO" G Va I (72.) for all 1 ^ i ^ n. 

Let t = \\t\\, it f G V, then s > p0 p * implies Q(scr) ~>2i 
(t) / n (N(sitr),... ,N(« p (r)) > 2 £ Q(t<r); otherwise N(s<r) > 2 £ 
N(icr) holds. 

Here we suppose safe(/) = {p + 1, . . . , n}. To show (f) one proceeds by induction on 
> p0 p. See [12| for the complete proof. □ 

Lemma 6.5.2. Let I — > r G 72., let <r: V — > Val(72.) be a substitution, and let A; = 
2 • max{size(r) | Z -> r € 72}. If Z > pop * r then Q(Zcr) »>* Q(r<r) for Q G {S, N}. 

Proof. Similar to the proof of Lemma 16.5.11 one shows the following property for terms 
s, t G V) where s is either a value or of form f(s±, . . . , s n ) such that sia G Val(72) 
for all 1 ^ i ^ n. 

Let t = \\t\\. If / G V, then s = f(s\,...,s n ) > pop * 
. . t implies (i) / n (N(si<r), . . . , N(s p cr)) S(ta) and (ii) 

W (/ n (N(sicr),...,N(spCj))) @ BN(sct) N(t<r). Otherwise 

if / G C then N(scr) ►a,? N(fcr) holds. 

Here we suppose safe(/) = {p + 1, . . . ,ra}. To show (|) one proceeds by induction on 
>pop*- See [12j for the complete proof. □ 

From Lemmata 16.5.11 and 16.5.21 the main lemma of this section follows. 

Lemma 6.5.3. Let s and t be terms such that s -*-> t and let k = 2 ■ max{size(r) | Z — > 
r G 72}. Then Q(s) Q(i) for Q G {S, N}. 
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Main Theorem. Let 1Z be a finite, completely defined constructor TRS. Assume fur- 
ther 1Z is compatible with > pop *- Then the induced (normal) runtime complexity is 
polynomial. 

Proof. Let t = f(ti, . . . ,t n ) be term in Tf, and without loss of generality let safe(/) = 
{p + 1, . . . , n}. We set k = 2 • max{size(r) | I — > r E 7?.}. By Lemma 16,5.31 any innermost 
rewrite steps t -*-> u induces S(t) S(u). Thus we obtain: 

DI (W) _U ) (/(ti,... ) t n )) = max{£ | 3u t -U< 

^ max{£ | 3 (si, . . . , s' e ) : S(i) si 
< G fe (S(/(t!,...,t n ))) 

Next note that S(/(*i, . . . , t n )) = (/ n (N(ti), . . . , N(t p )) 0...0). By Theorem EE] and 
the observation following Definition 16.4.31 we see that 

G fc ((/ n (N(t!), . . . , N(tp)) . . . 0)) < n + 1 + G fe (/ n (N(*i), . . . , N(t p ))) 

Employing Lemma [6X31 we see (for a fixed /) that n + 1 + G fc (/ n (N(ti), . . . , N(i p ))) 
is asymptotically bounded by a polynomial in the sum of the sizes of the arguments 
N(ii),. . . ,N(t p ). By definition size(N(^-)) = \\ti\\ ^ size(t») for all 1 < % ^ p. 

Hence for each term t £ Tj,, Dl^ -L>)(i) is bounded by a polynomial in the sum of the 
sizes of the normal argument terms of t. In particular, as the signature T is finite, the 
normal runtime complexity function is polynomial. □ 

Remark 6.5.1. In the above theorem we assume a constructor TRS. It is not difficult 
to see that this restriction is not necessary. (Essentially one replaces the application of 
Lemmata 16.5.11 and 16.5.21 by the application of the properties (f) and (|) respectively.) 
However, the restriction that the arguments of / are in normal form is necessary. Hence 
we prefer the given formulation of the theorem. 

6.6 Experimental Data 

To prove compatibility of a given TRS 1Z with recursive path orders we have to find a 
precedence > such that the induced order is compatible with 1Z. When we want to orient 
1Z by a polynomial path order > pop * we additionally require a suitable safe mapping. To 
automate this search we encode the constraint s > pop * t into a propositional formula: 

t(s > p0 p* t) = Ti(s > pop * t) V r 2 (s > pop * t) V r 3 (s > pop * t) V r 4 (s > pop * t) 

Here Tj(-) is designed to encode clause (i) from Definition 16.3.21 Based on such an 
encoding, compatibility of a TRS with > pop * becomes expressible as the satisfiability of 
the formula (/\z_> r e7?. >pop* r)) A P A S. Here the subformula P is satisfi able if and 
only if all the variables > f t9 (defined below) encode a strict precedence, see [1471 ] for a 
suitable definition of P. The subformula S is used to cover the additional conditions 
imposed on safe mappings defined in the beginning of Section 16.31 



• • • ►* 4} 
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We only describe cases (2)— (4), the encoding for case (1) — the comparison using the 
weaker order > p0 p — can be easily derived in a similar fashion. If s = f(si, . . . , s n ) we 
set T2(s > p0 p* t) = \J i si >p 0p * t, otherwise r 2 (s > pop * t) = _L. For case (3) we introduce 
for every function symbol / and argument position i of / the (propositional) variables 
/3t j, such that (3t j = true represents the assertion i £ safe(/). Moreover, for all function 
symbols /, g we introduce variables > f t9 such that truth of > f >g expresses that f > g 
holds. If s = f(si,...,s n ) and t = g(t\, . . . ,t m ) for / € V with / ^ g, we define 
i~3\8 >pop* t) as: 

m m 

>f,9 A V ( r ( s >p o p* *<) A ^ff»<o A A ( r ( s >p°p V ^ A ( s > 

£q=1 i=l,iy^io 

(For s, tof different shape, we set T3(s > pop * i) = -L) To deal with case (4) we 



follow 132[ | . The main idea is to describe a multiset comparison in terms of multiset 
covers. Formally, a multiset cover is a pair of mappings 7: {l,...,m} — ► {l,...,n} 
and e: {l,...,n} — > {true, false} such that for all i, j (1 ^ i ^ n, 1 ^ j ^ m): if 
e(i) = true then the set {j \ ^y(j) = i} is a singleton. It is easy to see that [s±, ... ,s n ] (y = 
)mui [ti, ■■■ ,t m ] if there exists a multiset cover (7, e) such that for each j there exists 
an i with j(J) = i and e(i) = true implies S{ = tj, while e(i) = false implies S{ >- tj. 
Similarly we obtain [si,...,s n ] >- mu | [ti,...,t m ] if [si,...,s n ] (>- = ) mu i [ti,...,t m ] and 
e(i) = false for some i G {1, . . . , n}. 

This definition allows an easy encoding of multiset comparisons and based on it, 
clause (4) of Definition 16.3.21 becomes representable (for terms s = /(si,...,s n ) and 
t = f(tx, . . . ,t m )) as the conjunction of the following two conditions together with the 
assumption that there exists a suitable multiset cover (7,6): 

- whenever = i then the indicated argument positions % and j, are either both 
normal or both safe, 

- at least one cover is strict (e(i) = false) for some normal argument position i of 
/• 

We introduce variables 7y and £j, where 7^ = true represents 7(7) = i and £j = true 
denotes e(i) = true (1 ^ i ^ n, 1 ^ j ^ m). Summing up, we set T4(s (> p0 p*)mui t) 
(s = f(si, . . . ,s„) and t = f(h, . . . ,t m )) equal to: 

n m 

A A ( £i -* r ( Si = A r ( Si ^ A ~ 

i=ij=i 

m n n 

A ^ one(7ij-, . . . ,7 n ,j) A f\[ £ i ~ > oree (7i,l; • • • >7i,m 

)) A V(^ A ^) 

j'=l i=l i=l 

Here one(ai, . . . , a n ) is satisfiable if and only if exactly one of the variables ai 3 . . . , a n 
is true. And if s, t do not have the assumed form, we set r 4 (s (> p0 p*)mui t) = _L. 
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We compare the polynomial pat h order POP* t o a restricted class of polynomial 
interpretations (SMC for short) [26f] and to LMPO 1091 ] . SMC refers to simple- mixed 
polynomial interpretations where constructor symbols are interpreted by a strongly linear 
(also called additive) polynomi al [26l| . Defined symbols on the other hand are interpreted 
by simple-mixed polynomials [43|]. Since POP* and LMPO are in essence syntactic 
restrictions of MPO we also provide a comparison to MPO. POP* is implemented using 
the previously described propositional encoding; while the implementation of SMC rests 
on a propositional encoding of the techniques described in [43[ . To check satisfiability we 
employ MiniSatH LMPO and MPO are implemented using an extension of the constraint 
solving technique described in [fj{J , which allows us to compare different implementation 
techniques at the same time. 

As testbed we use those TRSs from the termination problem data base version 4.0 
that can be shown terminating with at least one of the tools that participated in the 
termination competition 2007c| We use three different testbeds: T collects the 957 
terminating TRSs from TPDB, TC collects the 449 TRSs from the TPDB that are also 
constructor systems, and TCO collects the 236 TRSs that are terminating, constructor 
based and orthogonal! The results of our comparisons are given in Table HTT1 The tests 
presented below were conducted on a small complexity analyser running single-threaded 
on a 2.1 GHz Intel Core 2 Duo with 1 GB of memory. For each system we used a timeout 
of 30 seconds. 



Table 6.1: Experimental results 







POP* 


LMPO 


SMC 


MPO 


T 


Yes 


65 


74 


156 


106 




Maybe 


892 


812 


395 


847 




Timeout (30 sec.) 





71 


406 


4 


TC 


Yes 


41 


54 


83 


65 




Maybe 


408 


372 


271 


381 




Timeout (30 sec.) 





23 


95 


3 


TCO 


Yes 


19 


25 


38 


29 




Maybe 


217 


201 


147 


207 




Timeout (30 sec.) 





10 


51 





Averag 


e yes time (milliseconds) 


15 


14 


1353 


10 



Some comments: What is noteworthy is the good performance of POP*as a direct 
termination method in comparison to MPO. It is well-known that MPO implies primitive 

3 Available online at |http: //mini sat . se| 

4 These 957 systems can be found online: http: //www . lri . f r/~marche/termination-competition/2007/webf orm. cgi?cor 

5 The main reason for this delineation is that in related work [26I . Il09f | confluent constructor TRS are 
considered. 
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recursive derivation length, cf. 77]. In contrast to this POP* implies polynomial runtime 
complexity and is thus a much weaker order. Still more than half of the TRSs compatible 
with MPO are also compatible with POP*. On the other hand the comparison between 
POP* and LMPO is quite favourable for our approach. Compatibility with LMPO tells 
us that the given TRS is (in principle) polytime computable, while compatibility with 
POP* tells additionally that the runtime of a straightforward implementation (using an 
innermost strategy) is polytime computable. Hence compatibility with POP* provides us 
with a theoretical stronger result, while the difference on the experimental data appears 
negligible. 

The good performance of SMC in strength is a clear indication that currently (restric- 
tions of) semantic termination techniques (like polynomial interpretations) are of some 
interest in automatically estimating the runtime complexity of TRSs. This may be sur- 
prising, as for additive polynomial interpretations it is (almost) trivial to check that the 
induced upper bound on the derivation height is polynomial. However, the significant 
increase in the time necessary to find an additive polynomial interpretation, as indicated 
in Table 16. 1[ clearly shows the limits of semantic methods for large examples. 

6.7 An Application: Complexity of Scheme Programs 

In recent work together with Hirokawa and Middeldorp (see [13]]) we study the runtime 
complexity of (a subset of) Scheme programs by a translation into so-called S-expression 
rewrite systems (SRS for short). By designing the translation to be complexity preserv- 
ing, the complexity of the initial Scheme program can be estimated by analysing the 
complexity of the resulting SRS. Here we indicat e ho w our main theorem is applicable 



to (a subset of) S-expression rewrite systems, cf. [141]. 



Definition 6.7.1. Let K, be a set of constants, V be a set of variables such that Vn/C = 0, 
and o ^ K, U V a variadic function symbol. We define the set <S(/C, V) of S-expressions 
built from K and V as T(fC U {o}, V). We write (s\ ■ ■ ■ s n ) instead of o(si, . . . , s n ). An 
S-expression rewrite system (SRS for short) is a TRS with the property that the left- 
and right-hand sides of all rewrite rules are S-expressions. 

Let S be an SRS over S(IC, V) and let K = V U C such that V DC = 0. We call 
the elements of C constructor constants and the elements of T> defined constants. We 
momentarily redefine the notion of value in the context of SRSs. The set of values Val(tS) 
of <S with respect to C is inductively defined as follows: 

(i) if v e£ then v G Val(S), 

(ii) if v\,...,v n £ Val(S) and c G C then (c v\ . . .v n ) G Val(S). 

Observe that (defined) constants are values, this reflects that in Scheme procedures 
are values, cf. 1351 ] and allows for a representation of higher-order programs. Scheme 



programs are conceivable as SRSs allowing conditional if expressions in conjunction with 
an eager, i.e., innermost rewrite strategy. Thus we can delineate a class of SRSs that 
easily accommodate a suitably large subset of Scheme programs. 
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Definition 6.7.2. S is called a constructor if, for every I — > r G S, I = (Jo ■ ■ ■ l n ) with 
Iq G T> and G Val(<S) for all i G {1, . . . , n}. (Here the set of values Val(<S) is defined 
with respect to C.) 

Corollary 6.7.1. Let > denote a precedence on K, such that for all / G T> we have 
for all c G C: f > c and let > pop * denote the induced POP*. Let S be a constructor 
SRS compatible with > pop *. Then for all / G T> of arity n and for all values s\, . . . ,s n : 
Dl( 5 -L>)((f s\ ... s n )) is bounded by a polynomial in the sum of the sizes of the arguments 
•Sl j • • • j s n . 

Proof. It is important to note that the set of S-expressions <S(/C, V) equals T(/Cu{o}, V), 
i.e., SRSs are first-order rewrite systems, whose single defined symbol is the variadic 
function symbol o. 

Hence Theorem 16.7.11 follows almost immediately from Corollary 16.3.11 However the 
fact that according to the above definition values may contain defined symbol need to 
be taken into account. For that is suffices to redefine Definition 16.5.11 in the natural way. 
It is not difficult to argue that suitable adaption of Lemmata 16.5.11 and 16.5.21 to SRSs 
are provable. □ 



6.8 Conclusion 

In this paper we have introduced a restriction of the multiset path order, called polyno- 
mial path order (POP* for short). Our main result states that POP* induces polynomial 
runtime complexity. In Section 16.61 we have provided evidence that our approach per- 
forms well in comparison to related methods. In Section 16.71 the necessary theory to 
apply our main theorem in the context of (higher-order) functional languages with eager 
evaluations has been developed. In related work (together with Hirokawa and Middel- 
dorp), studying the termination behaviour and the runtime complexity of (a subclass of 
higher-order) Scheme programs, this basis has proven quite useful, cf. [3]. 

In concluding we also want to mention that as an easy corollary to our main the- 
orem we obtain that POP* also characterises the polytime computable functions. To 
be precise the polytime computable functions are exactly the functions computable by 
an orthogonal constructor TRS (based on a simple signature) compatible with POP*. 
(Here simple signature means that the size of any cons tructor term depends linearly on 
its depth, an equivalent restriction is necessary in (l5i|.) See Q for details. 



In future work we will strengthen the applicability of our method. The experimental 
evidence presented in Section f6.6l shows that compatibility of rewrite systems with POP* 
can be easily and quickly tested. However, the strength of the method seems to be im- 
provable. One possible field of future work is to extend POP* to quasi-precedences. The 
theoretical changes necessary to accomodate quasi-precedences seem to be manageable. 
Another natural exte nsion is to combine POP* with the transformation technique of 
semantic labeling, cf. 1 5d( ] . It is easy to see that semantic labeling (in the basic form) 



does not affect the derivation length. Furthermore for finite models the main theorem 
remains directly applicable. 
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Proving Quadratic Derivational 
Complexities using Context Dependent 

Interpretations 



Publication Details 

G. Moser and A. Schnabl. Proving quadratic derivational complexities using context de- 
pendent interpretations. In Proceedings of the 19th International Conference on Rewrite 
Technques and Applications, number 5117 in LNCS, pages 276-290. Springer Verlag, 



The International Conference on Rewriting Techniques and Applications has been ranked 
A by CORE in 2007. 

Abstract 

In this paper we study context dependent interpretations, a semantic termination method 
extending interpretations over the natural numbers, introduced by Hofbauer. We present 
two subclasses of context dependent interpretations and establish tight upper bounds on 
the induced derivational complexities. In particular we delineate a class of interpretations 
that induces quadratic derivational complexity. Furthermore, we present an algorithm 
for mechanically proving termination of rewrite systems with context dependent inter- 
pretations. This algorithm has been implemented and we present ample numerical data 
for the assessment of the viability of the method. 

7.1 Introduction 

In order to assess the complexity of a (terminating) term rewrite system (TRS for short) 
it is natural to look at the maximal length of derivation sequences, as suggested by Hof- 

1 This research was partially supported by FWF (Austrian Science Fund) project P20133. 
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bauer and Lautemann in [79]. To be precise, let 7Z denote a finitely branching and ter- 
minating TRS over a finite signature. The derivational complexity function with respect 
to 7Z (denoted as den) relates the length of the longest derivation sequence to the size of 
the initial term. For direct termination techniques it is often possible t o infer an upper 



bound on dc-ji(n) from the termination proof of 1Z, cf. |79l. 1771 . 1144 . Ilia . l56j |. (Currently 
it is unknown how to estimate the derivational complexity of a TRS 1Z, if termination 
of 1Z has been shown via t ransf ormation methods like the dependency pair method or 



semantic labeling, but see |115l . 1 74 ] for partial results in this direction.) For example 
linear derivational complexity can be verified by the use of automata techniques: lin- 
ear match-bounded TRSs induce linear derivational complexity, see [561 ] . Unfortunately 
such a feasible growth rate is not typical. Already termination proofs by polynomial 
interpretations imply a double-exponential upper bound on the derivational complexity, 
cf. [79J. In both cases the upper bounds are tight. 

However, the tightness of the mentioned bounds does not imply that the upper bounds 
are always optimal. In particular polynomial interpretations typically overestimate the 



derivational complexity. In 78] Hofbauer introduced so-called context dependent in- 
terpretations as a remedy. These interpretations extend traditional interpretations by 
introducing an additional parameter. The parameter changes in the course of evaluating 
a term, which makes the interpretation dependent on the context. The crucial advan- 
tage is that context dependent interpretations typically improve the induced bounds on 
the derivational complexity of TRSs. Furthermore this technique allows the handling of 



non-simple terminating systems. (See 78] and Section 17.21 for further details.) 

In this paper, we establish theoretical and practical extensions of Hofbauer's approach. 
As theoretic contributions, we present two subclasses of context dependent interpreta- 
tions, i.e., we introduce A-linear and A-restricted interpretations. We show that A-linear 
interpretations induce exponential derivational complexity, while A-restricted interpre- 
tations induce quadratic derivational complexity. Furthermore, we provide examples 



showing that these bounds are tight. In 78j] it is shown that context dependent in 



terpretations are expressive enough to show termination of TRSs that are not simply 
terminating. We improve upon this and show that A-restricted interpretations suffice 
here. On the practical side, we design an algorithm that automatically searches for A- 
linear interpretations and A-restricted interpretations, which shows that the technique 
can be mechanised. This answers a question posed by Hofbauer in [7^]. The procedure 
has been implemented and we provide ample numerical data to assess its viability. TRSs 
with polynomial derivational complexity appear to be of special interest. Thus, we fi- 
nally compare the applicability of our method to other termination techniques that also 
induce polynomial derivational complexity. 

The remainder of this paper is organised as follows. In the next section we recall 
basic notions and starting points of this paper. In Section 17.31 we introduce the class of 
A-linear interpretations and describe the algorithm that mechanises the search for A- 
linear and A-restricted interpretations. In Section \7A\ we obtain the mentioned results 
on the derivational complexities induced by either of these interpretations. Furthermore, 
we show in this section that already A-restricted interpretations allow the treatment of 



8G 



7.2 Context Dependent Interpretations 



non-simple terminating TRSs. Section 17.51 provides experimental data and finally in 
Section 17.61 we conclude and mention future work. 



7.2 Context Dependent Interpretations 



We assume familiarity with the basics of term rewriting, see 15j, 1 1371 ] . Knowledge of 



context dependent interpretations [78] will be helpful. Below we recall the basic r esult s 



from the latter paper in a slightly different, but equivalent way, compare [78l . 1 13 1 ] . 
See [3] for the motivation and intuition underlying the introduced concepts. 

Let T be a finite signature, let V be a set of variables and let TZ denote a terminating 
TRS over T. The induced relation — >7^. is assumed to be finitely branching. We simply 
write — > for — >n if TZ is clear from context. The derivation length of a term t with respect 
to TZ is defined as follows: d\n(t) = max{n | 3u t — > n u}. The derivational complexity 
(with respect to TZ) is defined as: dc-ji(n) = max{dl-R.(i) | \t\ ^ n}, where \t\ denotes the 
size of t, i.e., the number of symbols of t as usual. (For example the size of the term f (a, x) 
is 3.) We say the derivational complexity of TZ is linear, quadratic, double-exponential, if 
dcn(n) is bounded by a linear, quadratic, double-exponential function in n, respectively. 
A context dependent J- -algebra (CDA for short) C is a family of ^-"-algebras over the 
reals parametrised by a set D C R+ of positive reals. A CDA C associates to each 
function symbol / G T of arity n, a collection of n + 1 mappings: fc'-Dx (K^) n — > Rq" 
and f l c : D — > D for all 1 ^ i ^ n. As usual fc is called interpretation function, while 
the mappings f % c are called parameter functions. In addition C is equipped with a set 
{>a| A G D} of proper orders, where we define: z >a z' if and only if z — z' ^ A. 

Let C be a CDA and let a IS.- assignment denote a mapping: a : D x V — > Rq". We 
inductively define a mapping [a, A]c from the set of terms into the set Rjj~ of non-negative 
reals: 



[a,A] c (t) := 



a(A,t) ifieV 
/c(A, [a, /^(A)] c (ti), . . . , [a, #(A)] c (i n )) if i = f(h, ...,t n) 



We fix some notational conventions: Due to the special role of the additional variable 
A, we often write /c[A](zi, . . . , z n ) instead of /c(A, z%, . . . , z n ). Furthermore, we usually 
denote the evaluation of t as [a, A](i), if the respective algebra is clear from context. 

We say that a CDA C is A-monotone if for all A € D and for all ai, . . . , a n , b G Rq 
with a, > /i(a) & f° r some i G {1, . . . , n}, we have 

/c[A](oi, . . . ,Oi, . . . ,a„) > A /c[A](ai, . . . ,6, . . . ,a n ) . 

Note that if all interpretation functions /c[A] are weakly monotone with respect to the 
standard ordering on Rq", then validity of the inequalities 

f c [A]( Zl , . . . , Zi + f c (A), . . . , z n ) - f c [A]( Zl , . . . , Zi , . . . , z n ) ^ A , 



suffices in order to conclude A-monotonicity of C, cf. |7£ 

A CDA C is compatible with a TRS TZ (or TZ is compatible with C) if for every rewrite 
rule I — > r G 7^., every A G -D, and any assignment a: [a, A](Z) >a [ a >A](r) holds. 
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Example 7.2.1 ([78]). As running example, we consider the TRS 1Z\ with the single 
rewrite rule a(b(x)) — > b(a(x)). We assume D = R + . The following interpretation and 
parameter functions 

a c [A](z) = (l + A)z a* (A) A 



1 + A 

b c [A](z)=z + l b 1 c (A) = A, 



define a CDA C that is A-monotone and compatible with TZ\, compare 78J . 



Theorem 7.2.1 ([78J). Let 1Z be a TRS and suppose that there exists a A-monotone 
and compatible CDA C. Then 1Z is terminating and 

holds for all terms t € T(J-, V). 

The next example clarifies the impact of Theorem 17. 2. H compare [781 ] . 

Example 7.2.2. Consider the TRS Tlx together with the CDA C in Example [TXT! 
Suppose c € T is a constant and cc[A] = 0. We assert D = M + . Then we obtain 
[a, A](a"(b m (c))) = (1 + An)m and hence: 

[a,A](a"(b m (c))) = 1 , = ^ d | ( a «( b ™(c))) . 
A>0 A A>0 V A y 1V v v "' 

Furthermore, an easy inductive argument reveals: dl^ 1 (a n (b m (c))) = nm. Hence with 
respect to the term a n (b m (c)), compatibility with C entails an optimal upper bound 
on the derivation length of TZ±. This is also true for all g round terms. A proof of 

inf A >o = dl ^i (*) for a11 * G r ( JP ) can be found in & 

Definition 7.2.1. A A-quotient is an expression of the form 

A 



a + bA ' 

where a, b £ N and either a>0or6>0. A A-quotient d is nontrivial, if d ^ A. 

Lemma 7.2.1. Let d\, d2 be A-quotients and let d = d\[A := d 2 ] denote the result of 
substituting cfo for A in d\. Then d is a A-quotient. 

As usual a polynomial P in the variables z\ , . . . , z n (over the reals) is a finite sum 
T^ILx c i z% i ■ ■ ■ z rT- To accommodate A-quotients we slightly generalise polynomials. 

Definition 7.2.2. An extended monomial M in the variables A and Z\, . . . , z n is a finite 
product c • Y\ i Vi such that c is an integer and Vi is x n , x € {A, zi, . . . , z n } or is a 
A-quotient. The integer c is called the coefficient and the expression i>j a literal. Finally, 
an extended polynomial P over A G D and Zi , . . . , z n £ Rq is a finite sum ^ Mj of 
extended monomials Mj (in A and zi, . . . , z n ). 
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Note that the coefficients of an extended polynomial are integers. If the context 
clarifies what is meant, we will drop the qualifier "extended". Examples 17.2.11 and 17.2.21 
as well as the examples studied in [78f] suggest a restricted notion of context dependent 
algebras. This is the subject of the next definition. 

Definition 7.2.3. A polynomial context dependent interpretation of J 7 is a CDA (C, {>a| 
A G D}) satisfying the following properties: 

- the interpretation function fc is an extended polynomial, 

- the parameter set D equals M + , and 

- for each / € J- the parameter functions f % c are A-quotients. 

Lemma 7.2.2. Let C denote a polynomial context dependent interpretation, let a be a 
A-assignment, and let t be a term. Then [a, A](t) is an extended polynomial. 

Proof. The lemma is a direct consequence of the definitions and Lemma l7.2.11 □ 

Remark 7.2.1. Hofbauer showed in [7|i] that for any monotone polynomial interpreta- 
tion compatible with a TRS 1Z, there exists a polynomial context dependent interpreta- 
tion which is A-monotone and compatible with 1Z and induces at least the same upper 
bound on the derivational complexity as the polynomial interpretation. 

7.3 Automated Search for Context Dependent Interpretations 

One approach to find context dependent interpretations (semi-) automatically was al- 
ready mentioned in Hofbauer's paper [t3 |. A given polynomial interpretation is suitably 
lifted to a context dependent interpretation such that monotonicity and compatibility 
are preserved, but the upper bound on the derivational complexity is often improved. 
Unfortunately, experimental evidence suggests that the applicability of this heuristics is 
limited, if one is interested in automatically finding complexity bounds, see Section 1731 
for further details. However, the standard approach for automatically proving termina- 
tion via polynomial interpretations as stipulated by Contejean et al. [43[] can be adapted. 
The description of this adaption is the topic of this section. We restrict the form of para- 
metric interpretations that we consider. 

Definition 7.3.1. A (parametric) A-linear interpretation is a polynomial context de- 
pendent interpretation C whose interpretation functions and parameter functions have 
the following form: 



n 



n 




i=l i- 



i=\ 



A 



a (f,i) + b (f^ A 
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where the occurring coefficients are supposed to be natural numbers. For a parametric 
A-linear interpretation, 0(/ 5 i), &(/,i)> c /i an d df (/ G J 7 , 1 ^ i ^ n) are called coefficient 
variables. 

Note that for any A-linear interpretation, we have > or £>(/,i) > (/ € J-, 

1 ^ i ^ n): Any A-linear interpretation is a polynomial context dependent interpreta- 
tion by definition. And hence the parameter functions have to be A-quotients, cf. Defi- 
nition [7231 Moreover the coefficients «(/,«), b(f,i) are used in the interpretation function 
and the parameter functions. This is necessary for the correctness of Lemma [7.3.11 b elow . 

Example 7.3.1. Consider the TRS 1Z\ from Example 17.2.11 The parametric interpre- 
tation and parameter functions have the form: 

a c [A] (z) = az + bzA + cA + d 

bc[A](z) = ez + fzA + gA + h 

The following lemma is a direct consequence of the definitions. 

Lemma 7.3.1. Let C be an A-linear interpretation. Then C is A-monotone. 

Due to Lemma 17.3.11 in order to prove termination of a given TRS 1Z, it suffices to 
find a A-linear interpretation compatible with 1Z. This observation is reflected in the 
following definition. 

Definition 7.3.2. Let 1Z be a TRS and let C be a parametric A-linear interpretation. 
The compatibility constraints of 1Z with respect to C are defined as 

CC(K,C) ={[a,A](i) - [a, A](r) - A ^ | / -> r e ft}U 

U {o (/)i) + -1^0|/e.F,l<i< ar(/)} . 

Here ar(/) denotes the arity of / and a refers to a symbolic A- assignment: Expressions 
of the form [a, A](x) for x € V remain unevaluated. 

While the first half of CC(1Z,C) represents compatibility with 1Z, the second set of 
constraints guarantees that the denominators of the occurring A-quotients are different 
from 0. Thus any solution to CC(7Z, C), instantiating coefficients with natural numbers, 
represents a polynomial context dependent interpretation compatible with 1Z. 

Example 7.3.2. Consider the (parametric) CDA C from Example 17.3.11 and set Ai = 
a^(A) and A 2 = b£(A). Let a x = [a,A 2 [A := Ai]](x) and let q 2 = [a,Ai[A := A 2 ]](x). 
Then the constraint [a, A](a(b(x))) — [a, A](b(a(x))) — A ^ becomes: 

(aeai + afa>iA 1 + agA 1 + beaiA + 6/«iAiA + bgA 1 A + (bh + c)A+ 
+ah + d) - (aea 2 + bea 2 A 2 + ceA 2 + afa 2 A + bf a 2 A 2 A + c/A 2 A+ 
+(df + g)A + de + h) - A ^ . 



he (A) 



a + 6A 
A 
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For all constraints (P ^ 0) € CC(1Z,C), P is an extended polynomial, cf. Lemma [7.2,2i 
It is easy to see how an extended polynomial (over A, z\, ■ ■ ■ , z n ) is transferable into a 
(standard) polynomial (over A, z±, . . . , z n ): Multiply (symbolically) with denominators 
of (nontrivial) A-quotients till all (nontrivial) A-quotients are eliminated. This simple 
procedure is denoted as A. Correctness and termination of the procedure follow trivially. 

Definition 7.3.3. Let 1Z be a TRS and let C be a parametric A-linear interpretation. 
The polynomial compatibility constraints of 7Z with respect to C are defined as follows: 
PCC(ft,C) ■= {P' > | P ^ € CC{K,C) and P' := A(P)}. 

Example 7.3.3. Consider the constraint P ^ depicted in Example 17.3.21 To apply 
the algorithm A we first have to symbolically multiply with the expression a + bA and 
later with e + /A. The resulting constraint P' ^ (with the polynomial P' in the 
"variables" A, a%, and a 2 ) has the form: 

((b 2 ef + 6/ 2 )aiA 3 + {2abef + af + b 2 e 2 + bef) ai A 2 
+(2abe 2 + a 2 ef + ae/)«iA + (a 2 e 2 )ai) 
-({abf 2 + 6 2 /)a 2 A 3 + (a 2 / 2 + 2a6e/ + 06/ + 6 2 e)a 2 A 2 
+(2a 2 e/ + abe 2 + aeb)a 2 A + (a 2 e 2 )a 2 ) + ((& 2 //i - bdf 2 - bf)A 3 

+(2abfh + b 2 eh + fed/ - adf 2 - 2bdef - bfh -be- af)A 2 
+(a 2 fh + 2abeh + adf + bde — 2adef — afh — bde 2 — beh — ae))A 
+(a 2 eh + ade — ade 2 — aeh)) . 

We obtain PCC(7£i,C) = {P 7 ^ 0, a + 6 - 1 > 0, e + / - 1 > 0}, where the last two 
constraints reflect that all denominators of A-quotients are non-zero. 

Let P be a constraint in PCC(7£,C) such that n distinct symbolic assignments 
[a, d](x) occur in P (x G V, d a A-quotient). (In Example 17.3.31 two symbolic assign- 
ments occur: ol\ and a 2 -) Then P is conceivable as a polynomial in Z[A, zi, . . . ,z n ]. 
It remains to verify that (a suitable instance of) P is positive, i.e., we have to prove 
that P(A, Zi, . . . , z n ) ^ for any values A > 0, Zi ^ 0. This is achieved by testing for 
absolute positivity instead of positivity, compare |43l |. 

A polynomial P is absolutely positive if P has non-negative coefficients only. A para- 
metric polynomial P is called absolutely positive if there exists an instance P' of P such 
that P' is absolutely positive. Clearly any absolutely positive polynomial is positive. 
Thus for a given constraint P ^ € PCC(7£, C) it suffices to find instantiations of 
the coefficient variables such that all coefficients are natural numbers. This is achieved 
through the construction of suitable Diophantine inequalities over the coefficients. 

Lemma 7.3.2. Let 1Z be a TRS and let C denote a parametric A-linear interpretation. 
If for all P ^ E PCC(TZ,C), P is absolutely positive then there exists an instantiation 
of C compatible with TZ. 

Proof. If P is absolutely positive, there exist natural numbers that can be substituted to 
the coefficient variables in P such that the resulting polynomial P' is absolutely positive 
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and thus positive. By definition this implies that the constraints in CC(TZ, V) are fulfilled. 
We define an instantiation C of C by applying the same substitution to the coefficient 
variables in C. Then C is compatible with 1Z. □ 

As an immediate consequence of Lemmata I7.3.1I I7.3.2I and Theorem I7.2.1I we obtain 
the following theorem. 

Theorem 7.3.1. Let 7Z be a TRS and let C denote a parametric A-linear interpretation. 
Suppose for all P ^ G PCC(7£, C), P is absolutely positive. Then 1Z is terminating and 
property (|7,ip holds for D = M + . 

It is easy to see that the Diophantine inequalities induced by Example 17.3.31 cannot 
be solved, if the symbolic assignments ol\ and 02 are treated as different variables. This 
motivates the next definition. 

Definition 7.3.4. Given a TRS 1Z and a A-linear interpretation C, the equality con- 
straints of 1Z with respect to C are defined as follows: 

EC(K,C) = {(a + 6A) - (c + dA) = | Property (*) is fulfilled} 

(*) There exists P ^ G PCC(7£,C), i£V such that [a, di](x) and [a, d2](x) occur in 
P and dt = ^ ^ ^ = da- 

Example 7.3.4. Consider Example 17. 3. 31 Property (*) is applicable to the A-quotients 
di, d2 in the A-assignments ot\ = [a,d\\ and «2 = [as d2] as 

A A 

1 ~ ae + (6e + /) A ^ ae + (a/ + 6) A ~ 2 ' 

Thus the constraint (ae + (be + /)A) — (ae + (af + 6) A) = occurs in EC(1Z\,C). This 
is the only constraint in EC(7£i,C). 

Let ? ^ £ PCC(1Z,C), assume the equality constraints in EC(7£,C) are fulfilled and 
assume we want to test for absolute positivity of P. By assumption distinct symbolic 
assignments can be treated as equal, which may change the coefficients we need to 
consider in P. This is expressed by writing P ^ € PCC(7£, C) U EC(7£, C). Furthermore, 
we call a parametric polynomial a zero polynomial if there exists an instance P' of P 
such that P' = 0. 

Corollary 7.3.1. Let 7£ be a TRS and let C denote a parametric A-linear interpretation. 
Suppose for all P ^ (P = 0) G PCC(^,C) U EC(7fc,C), P is absolutely positive (P is a 
zero polynomial). Then 1Z is terminating and property (|7.ip holds for D = M + . 

Corollary 17.3.11 opens the way to efficiently search for CDAs: Finding a A-monotone 
and compatible CDA C amounts to solving the Diophantine constraints in PCCCJZ, C) U 
EC(TZ, C). Recall that solvability of Diophantine constraints is undecidable [ll3[ |. How- 
ever, there is an easy remedy for this: we restrict the domain of the coefficient variables 
to a finite one. 
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Example 7.3.5. Consider the TRS TZ± from Example 17,2.11 and the A-linear interpre- 
tation C from Example 17.3.11 Applying the above described algorithm, the following 
Diophantine (in)equalities need to be solved. 

b 2 ef + bf 2 - abf 2 -b 2 f^0 abe 2 + a 2 ef + aef - 2a 2 ef - aeb ^ 
b 2 fh - bdf 2 -bf ^ a 2 eh + ade - ade 2 - aeh > 

a + b-l^O e + f - 1 ^ 

be + f-af-b = af 2 + b 2 e 2 + 6e/ - a 2 / 2 - abf - 6 2 

2abfh + b 2 eh + bdf - adf 2 - 2bdef -bfh-be-af ^ 

a 2 //i + 2abeh + ad/ + bde — 2adef — afh — bde 2 — beh — ae . 

Here the constraints a + b — 1 ^ 0, e + / — 1 ^ guarantee that the denominators of 
occurring A-quotients are positive, and the equality be + f — af — b = expresses the 
equality constraint in EC(TZi,C). Our below discussed implementations of the algorithm 
presented in this section find the following satisfying assignments for the coefficient vari- 
ables fully automatically: 

a=b=e=h=l c=d=f=g=0. 



7.4 Derivational Complexities Induced by Polynomial Context 
Dependent Interpretations 

In this section we show that the derivational complexity induced by A-linear interpreta- 
tions is exponential and that this bound is tight. Furthermore, we introduce a restricted 
subclass of A-linear interpretations that induces (tight) quadratic derivational complex- 
ity- 
Recall the TRS IZi considered in Example 17.2.11 This TRS belongs to a family of 
TRSs K k for k > 0: a(b(x)) -> b fc (a(x)) and it is not difficult to see that for k ^ 2 the 
derivational complexity of 1Z}~ is exponential. In [78| A-linear interpretations were 
introduced such that 

inf KA] Cfc (t) =d 
A>0 A v / ' 

holds for any ground term. I.e., for all k > there exist A-linear interpretations that 
optimally bound the derivational complexities of IZt . This triggers the question whether 
we can find such context dependent interpretations automatically. The next example 
answers this question affirmatively, for k = 20 

Example 7.4.1. Consider the TRSs K 2 : a(b(x)) -» b(b(a(x)))i To find a A-linear 
interpretation, we employ the same parametric interpretation C, as in Example 1 7. 3 . 1 1 and 



The answer remains positive for k = 3. Detailed experimental evi- 

dence and additional information on the considered constraints are available 
at |http : / / cl- inf ormatik . uibk . ac . at/~ aschnabl/experiments/cdi/ 
3 This is Example 2.50 in Steinbach and Kiihler's collection . 
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build the set of constraints CC(TZ2,C) and consecutively the polynomial compatibility 
constraints PCC(7^2,C) together with the equality constraints EC(7?-2,C). We only state 
the (automatically) obtained interpretation and parameter functions: 

a c [A](z) = (2 + 2A)z a£(A) = 

bc[A](z) = z + l b 1 c (A) = A. 

As a consequence of Example 17.4. II we see the existence of TRSs, compatible with A- 
linear interpretations, whose derivational complexity function is exponential. Moreover, 
we have the following lemma. 

Lemma 7.4.1. Let C denote a A-linear interpretation and let K denote the maximal 
coefficient occurring in C. Further let t be a ground term, a a A-assignment and A > 0. 
Then [a,A](t) < (K + 2)1*1 (A + 1). 

Proof. Straightforward induction on i. □ 

Theorem 7.4.1. Let TZ be a TRS and let C denote a A-linear interpretation compatible 
with TZ. Then TZ is terminating and dcn(n) = 2°( n ). Moreover there exists a TRS TZ 
such that dc n {n) = 2 n ( n \ 

Proof. The proof of the upper bound follows the pattern of the proof of Theorem 17.4.21 
below. To show that this upper bound is tight, we consider the TRS TZ2 from Exam- 
ple [7XIJ It is easy to see that dc^ 2 (n) = 2 n ^ holds. □ 

In order to establish a termination method that induces polynomial derivational com- 
plexity, we restrict the class of A-linear interpretations. 

Definition 7.4.1. A A-restricted interpretation is a A-linear interpretation. In addition 
we require that for the interpretation functions and parameter functions 

n n 

f C (A, Zi, . . . , Z n ) = ^ a (f,i) Z i + b UA ZiA + C / A + d f 
i=l i=l 



a (f,i) + b (f,*) A 

we have aif^\ € {0, 1} for all 1 ^ i ^ n. 

Example 7.4.2. Consider the TRS TZ\ from Example 17.2.11 The assignment of coeffi- 
cient variables as defined in Example 17.3.51 induces a A-restricted interpretation. 

Lemma 7.4.2. Let C denote a A-restricted interpretation with coefficients ct(/,i), &(/,»)> 
Cf, dj (/ G J 7 , 1 ^ i ^ ar(/)) and we set 

M := max({c / ,d / \ f e J 7 } U {1}) 

TV := max({6 (/) i) | / e ^ 1 < i < ar(/)} U {1}) . 

Further let i be a ground term, a a A-assignment and let A > 0. Then [a, A](t) ^ 
M(\t\ + N\t\ 2 A). 
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Proof. We proceed by induction on t. As t € T{T\ the evaluation is independent of the 
assignment. Hence we write [A](t) instead of [a, A](t). If t = f £ J 7 , then 

[A](t) = c f A + d f < Af (A + 1) < M(\t\ + N\t\ 2 A) . 

If on the other hand t = f{ti, . . . , t n ), then 



[A](t) = J>,< + b fi A)[fc(mU) + c f A + d, (7.2) 

i 

= Efe + 6 /i A ) M l^l + AfiV|^| 2 A) + c/A + d f (7.4) 

i 

< E((! + iVA)M|ti| + Mi\T|tj| 2 A) + M(A + 1) (7.5) 

i 

^ J^|ti|((l + iVA)M + AfJV(|t| - 1)A) +M(A + 1) (7.6) 

i 

= (\t\ - 1)((1 + NA)M + MN(\t\ - 1)A) +M(A + 1) (7.7) 

= M((\t\ - 1)(1 + iVA) + iV(|t| - 1) 2 A + (A + 1)) (7.8) 

< M(\t\ + N\t\ 2 A) . (7.9) 



In line (|7.3p we employ the induction hypothesis, in (|7.6|) we use |tj| ^ |i| — 1 and for (|7.9|) 

a simple calculation reveals: (|i| - 1)(1 + NA) + NA(\t\ - l) 2 + (A + 1) = 

\t\ + N\t\ 2 A + A- N\t\A ^\t\ + N\t\ 2 A. □ 



Theorem 7.4.2. Let 7Z be a TRS and let C denote a A-restricted interpretation com- 
patible with 1Z. Then 1Z is terminating and dc^(n) = 0(n 2 ). Moreover there exists a 
TRS 7e such that dc^(n) = ft(n 2 ). 

Proof. By Theorem 17.2.11 7£ is terminating and by Lemma 17.4.21 there exists K E N, 
such that for any ground term t: [A](t) sC + -fT|i| 2 A) ^ i^ 2 |i| 2 (A + 1) and hence 

dWt , <b fM< inf jgffi^ = A-|^ . 
v A>o A A>0 A 11 

We obtain dl-^(t) = 0(|i| 2 ) for any t € T{F,V) and thus dc^(n) = 0(n 2 ). The tightness 
of the bound follows by Example 17.2.11 □ 



By definition the constant employed in Theorem 17.4.21 depends only on the employed 
interpretation functions. Moreover this dependence is linear. In concluding this section, 
we want to stress that A-restricted interpretation are even strong enough to handle 
non-simple terminating TRSs. 



95 



7 Proving Quadratic Derivational Complexities using Context Dependent 
Interpretations 

Example 7.4.3 ([78]). Consider the TRS K with the one rule a(a(x)) -> a(b(a(x))). 
By applying the algorithm described in Section P7.3|, we find the below given A-restricted 
interpretation C automatically: 

a c [A](z) = 2zA + 2 b c [A](z)=zA a£(A) = I b£(A) = 1 . 

By Theorem 17.3. 1| C is compatible with 1Z. Hence Theorem 17.4.21 implies that the 
derivational complexity of 1Z is (at most) quadratic. 



7.5 Experimental Results 

In this section we describe the programs cdii, cdi2, and cdi3. These programs provide 
search procedures for context dep endent interpretations. The program cdii implements 



the heuristics of Hofbauer in [78J], mentioned in Section [7.31 above. On the other hand, 
programs cdi2 and cdi3 implement the algorithm presented in Section [7.31 and incorpo- 
rate constraint solvers for Diophantine (in)equalities. The program cdii searches for 
A-linear interpretations, while cdi2 and cdi3 can search for A-linear and A-restricted 
interpretations. We summarise further differences below: 

cdii Firstly, the program searches for a polynomial interpretation compatible with a 
TRS 1Z. This interpretation is then lifted to a polynomial context dependent 
interpretation C as follows: Coefficients of the form k + 1 are replaced by k + 
A. Finally Mathematics^ is invoked to verify that the resulting CDA C is A- 
monotone and compatible with 1Z. 

cd'\2 This programs employs a constraint propagation procedure to solve the Diophantine 
constraints in PCC(7Z,C) U EC(7Z, C). Essentially the implementation follows the 
technique suggested in [431 ] . 

cdi3 The Diophantine (in)equalities in PCC(TZ, C) U EC(JZ, C) are translated into proposi- 
tional logic and suitable assignments are found by employing a SAT solver, in our 
case MiniSatH. The implementation follows ideas presented in 51] and employs 
the plogic library of TyTpJ! 

The implementation of the transformation steps as described in Section [7.31 is the same 
for cdi2 and cdi3. The programs cdii, cdi2, and cdi3 are written in OCanriZI (and parts of 
cdii in C). All three programs are fairly small: cdii consists of about 2000 lines of code, 
while cdi2 and cdi3 use roughly 3000 lines of code each. In Table ED we summarise the 
comparison between the different programs cdii, cdi2, and cdi3. The numbers in the third 
line of the table refer to the number of bits maximally used in cdi3 to encode coefficients. 
Correspondingly for cdi2 we used 32 as strict bound on the coefficients. We are interested 



4 http : //www. wolf ram. com/products/mathematica/ 
J http : //minisat . s e/| 

6 http : //colo6-c703 ~iiibk . ac . at/ttt2/ 1 

7 |http : //www ■ caml . inria. f r/ 
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Table 7.1: 957 terminating TRSs 





cdii 


cd 


12 


cdi 3 






A-lin. 


A-restr. 


A-lin. 


A-restricted 




A-linear 










3 4 5 


3 


4 5 


# success 


19 


61 


62 


86 86 86 


82 


82 83 


average time 




3132 


3652 


4041 4008 5496 


4981 


5010 5527 


# timeout 




276 


782 


189 222 238 


687 


751 797 



in automatically verifying the complexity of terminating TRSs. Consequentially, as 
testbed we employ those 957 TRSs from the version 4.0 of the Termination Problem 
Data Base (TPDB for short) that can be shown terminating with at least one of the 
tools that participated in the termination competition 2007o The presented tests were 
performed single-threaded on a 2.40 GHz Intel@ Core™ 2 Duo with 2 GB of memory. 
For each system we used a timeout of 60 seconds, the times in the tables are given in 
milliseconds. 

Observe that the heuristic proposed in (7§] is not suitable as an automatic procedure. 
(We have not indicated the time spent by cdii as the timing is incomparable to the stand- 
alone approach of cdi2 or cdi3.) With respect to the comparison between cdi2 and cdi3, 
the latter outperforms the former, if at least 2 bits are used. Perhaps surprisingly the 
performance of cdi2 and cdi3 on A-restricted and A-linear is almost identical. This can 
be explained by the strong impact of larger bounds for the coefficients ot(/,i) (/ G J 7 , 1 ^ 
i ^ ar(/)) in the complexity of the issuing Diophantine (in)equalities. However, for both 
programs cdi2 and cdi3, the stronger technique gains one crucial system: Example l7.4.11 

Table 17.21 relates existing methods that induce polynomial derivational complexities 
of TRSs to cdi3. SL refers to strongly linear interpretations, i.e., only interpretation 
functions of the form /yi(xi, . . . , x n ) = Y^i + c, c € N are allowed. Clearly compatibil- 
ity with strongly linear interpretations induces linear derivational complexit y. S econdly, 
TyTbox refers to the implementation of the match-bound technique as in [98|]: Linear 
TRSs are tested for match-boundedness, non-linear, but non-duplicating TRSs are tested 
for match-raise-boundedness. This technique again implies linear derivational complex- 
ity. (Employing [8(| (as in [5fJ) one sees that any match-raise bounded TRS has linear 
derivational complexity. Then the claim follows from Lemma 8 in [9^].) Note that the 
restriction to non-duplicating TRS is harmless, as any duplicating TRS induces at least 
exponential derivational complexity. No further termination methods that induce at 
most polynomial derivational complexities for TRSs have previ ously bee n known. In 
particular related work on implicit complexity (for example 26, 1091 . 111 . U,!^) does 



not provide methods that induce polynomial derivational complexities, even if sometimes 
the derivation length can be bounded polynomially, if the set of start terms is suitably 
restricted. Finally cdi + denotes our standard strategy: First, we search for a strongly 
linear interpretation. If such an interpretation cannot be found, then a A-restricted 



8 These 957 systems and full experimental evidence can be found at 
http : // cl-inf ormatik.uibk. ac . at/~ aschnabl/experiments/cdi/ 
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Table 7.2: Termination Methods as Complexity Analysers 

SL TjTbox cdi3 — A-restricted cdi + — A-restricted 

# success 41 125 86 87 
average time 20 577 3986 3010 

# timeout 225 238 237 



interpretation is sought (with 5 bits as bound). 

Some comments on the results reported in Table 17. 2\ By definition the set of TRSs 
compatible with a strongly linear interpretation is a (strict) subset of those treatable 
with cdi + . On the other hand the comparison between TjTbox and cdi + (or c6\^) may 
appear not very favourable for our approach. However, cdi + (and cdi^) can handle 
TRSs that cannot be handled by TjTbox. More precisely with respect to A-restricted 
interpretations cdi + (and cdia) can handle 38 (37) TRSs that cannot be handled with 
TjTbox. For instance the following example can only be handled with cdi + (and cdia). 

Example 7.5.1. Consider the fol lowin g; rewrite system 7£+ r . (This is Example 2.11 in 
Steinbach and Kiihler's collection 13fJ.) 



0+y -> y 0-y -> y s(x)-s(y) -> x-y 

s(x)+y — > s(x+y) x— — > x 

It is easy to see that TZ+ r is compatible with the following (automatically generated) 
A-restricted interpretation C. 

- c [A](x,y) =x + y + 3yA + 2A C [A]=0 
+ c [A](x,y) = x + y + xA + A s c [A](x) =x + 2 , 

with parameter functions: -£(A) = +£(A) = s£(A) = A, - 2 C {A) = and +e(A) = 

jAp- . Due to Theorem 17.4.21 we conclude quadratic derivational complexity, while the 
standard polynomial interpretation would only allow to conclude an exponential upper 
bound. Note that the deduced quadratic derivational complexity provides an optimal 
upper bound. 

Another issue is the high average yes time (and the higher number of timeouts) of 
cdi3 and cdi + in relation to existing techniques. Although a closer look reveals that the 
total times spent by TjTbox and cdi + (or cdis) is relatively equal, an improvement of 
the efficiency of the introduced tools seems worthwhile. 

Remark 7.5.1. Note that cdi + in conjunction with TjTbox can automatically verify 
that 163 TRSs in the testbed are of at most quadratic derivational complexity. Put 
differently more than 10% of all 1381 TRSs (and more than a third of the 445 non- 
duplicating TRSs) in version 4.0 of the TPDB are of quadratic derivational complexity. 
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7.6 Conclusion 

In this paper we have presented two subclasses of context dependent interpretations, 
and established tight upper bounds on the induced derivational complexities. More pre- 
cisely, we have delineated two subclasses: A-linear and A-restricted context dependent 
interpretations that induce exponential and quadratic derivational complexity, respec- 
tively. Further, we introduced an algorithm for mechanically proving termination of 
rewrite systems with context dependent interpretations. As a consequence we estab- 
lished a technique to automatically verify quadratic derivational complexity of TRSs. 
Finally, we reported on different implementations of this algorithm and presented nu- 
merical data to compare these implementations with existing methods that allow to 
automatically verify polynomial derivational complexity of TRSs. 

We believe the here presented approach can be extended further. A starting point 
for future work would be to decide whether it is possible to define additional subclasses 
of context dependent interpretations inducing polynomial derivational complexities that 
grow faster than quadratic. One possible approach is to drop the restriction to integer co- 
efficients and thus generalise the notion of polynomial context dependent interpretations. 
By Tarski's quantifier elimination method, such an extension turns the undecidable pos- 
itivity problem for Diophantine (in) equalities into a decidable problem. Further research 
will clarify the impact of this extension. A crucial problem in practical considerations is 



the known ineffectivity of quantfier elimination, see for example 34] 
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Abstract 

In this paper, we present a variant of the dependency pair method for analysing run- 
time complexities of term rewrite systems automatically. This method is easy to im- 
plement, but significantly extends the analytic power of existing direct methods. Our 
findings extend the class of TRSs whose linear or quadratic runtime complexity can be 
detected automatically. We provide ample numerical data for assessing the viability of 
the method. 

8.1 Introduction 

Term rewriting is a conceptually simple but powerful abstract model of computation 
that underlies much of declarative programming. In order to assess the complexity of a 

1 This research was partially supported by FWF (Austrian Science Fund) project P20133. 
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(terminating) term rewrite system (TRS for short) it is natural to look at the maximal 
length of derivation sequences, as suggested by Hofbauer and Lautemann in [79f] . More 
precisely, the derivational complexity function with respect to a (terminating and finitely- 
branching) TRS TZ relates the length of the longest derivation sequence to the size of the 
initial term. For direct termination techniques it is often possible to establish upper- 
bounds on the growth rate of the de riva tion al co mplexity function from the termination 
proof of TZ, see for example 7sJ, 77, 144, 78, 115 . 

However, if one is interested in methods that induce feasible (i.e., polynomial) com- 
plexity, the existing body of research is not directly applicable. On one hand this is due 
to the fact that for standard techniques the derivational complexity cannot be contained 
by polynomial growth rates. (See [56y for the exception to the rule.) Already termination 
proofs by polynomial interpretations induce a double-exponential upper-bound on the 
derivational complexity, cf. [7^]. On the other hand this is — to some extent — the conse- 
quence of the definition of derivational complexity as this measure does not discriminate 
between different types of initial terms, while in modelling declarative programs the 
type of the initial term is usually quite restrictive. The following example clarifies the 
situation. 



Example 8.1.1. Consider the TRS TZ 



is_empty(nil) — ► T 5 

is_empty(x :: y) — > _L 6 

hd(x :: y) — > x 7 
t\(x ::y)^y 



append(x, y) 
ifappend(x, y, nil) 
ifappend(x, y, u :: v) 



ifappend(x, y, x) 

y 

u :: append(u, y) 



Although the functions computed by TZ are obviously feasible this is not reflected in the 
derivational complexity of 7Z. Consider rule 5, which we abbreviate as C[x] — > D[x,x]. 



Since the maximal derivation length starting with C 
admits (at least) exponential derivational complexity. 



[x] equals 2™" 1 for all n > 0, TZ 



After a moment one sees that this behaviour is forced upon us, as the TRS 7Z may 
duplicate variables, i.e., TZ is duplicating. Furthermore, in general the ap plica bility of 
the above results is typically limited to simple termination. (But see [78 



113 . |59| for 



exceptions to this rule.) To overcome the first mentioned restriction we propose to study 
runtime complexities of rewrite systems. The runtime complexity function with respect 
to a TRS TZ relates the length of the longest derivation sequence to the size of the 
arguments of the initial term, where the arguments are supposed to be in normal form. 
In order to overcome the second restriction, we base our study on a fresh analysis of 
the dependency pair method. The dependency pair method [§j is a powerful (and easily 
automatable) method for proving termination of term rewrite systems. In contrast to the 
above cited direct termination methods, this technique is a transformation technique, 
allowing for applicability beyond simple termination. 

Studying (runtime) complexities induced by the dependency pair method is challeng- 
ing. Below we give an (easy) example showing that the direct translations of original 
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theorems formulated in the context of termination analysis is destined to failure in the 
context of runtime complexity analysis. If one recalls that the dependency pair method 
is based on the observation that from an arbitrary non-terminating term one can extract 
a minimal non-terminating subterm, this is not surprising. Through a very careful inves- 



tigation of the original formulation of the dependency pair method (see [9|, [57| , but also 
[721] ). we establish a runtime complexity analysis based on the dependency pair method. 
In doing so, we introduce weak dependency pairs and weak innermost dependency pairs 
as a general adaption of dependency pairs to (innermost) runtime complexity analysis. 
Here the innermost runtime complexity function with respect to a TRS 1Z relates the 
length of the longest innermost derivation sequence to the size of the arguments of the 
initial term, where again the arguments are supposed to be in normal form. 

Our main result shows how natural improvements of the dependency pair method, like 
usable rules, reduction pairs, and argument filterings become applicable in this context. 
Moreover, for innermost rewriting, we establish an easy criterion to decide when weak 
innermost dependency pairs can be replaced by "standard" dependency pairs without 
introducing fallacies. Thus we establish (for the first time) a method to analyse the 
derivation length induced by the (standard) dependency pair method for innermost 
rewriting. We have implemented the technique and experimental evidence shows that 
the use of weak dependency pairs significantly increases the applicability of the body 
of existing results on the estimation of derivation length via termination techniques. 
In particular, our findings extend the class of TRSs whose linear or quadratic runtime 
complexity can be detected automatically. 

The remainder of this paper is organised as follows. In the next section we recall basic 
notions and starting points of this paper. Sections 18.31 and 18.41 introduce weak depen- 
dency pairs and discuss the employability of the usable rule criterion. In Section [8.51 we 
show how to estimate runtime complexities through relative rewriting and in Section 18.6 
we state our Main Theorem. The presented technique has been implemented and we 
provide ample numerical data for assessing the viability of the method. This evidence 
can be found in Section 18.71 Finally in Section 18.81 we conclude and mention possible 
future work. 



8.2 Preliminaries 



We assume familiarity with term rewriting 15j, 1 1371 ] but briefly review basic concepts 
and notations. Let V denote a countably infinite set of variables and J- a signature. The 
set of terms over T and V is denoted by T(JF, V). The root symbol of a term t is either t 
itself, if t € V, or the symbol /, if t = f{t\, . . . , t n ). The set of position 'Pos(i) of a term 
t is defined as usual. We write Vosg{t) C Vos(t) for the set of positions of subterms, 
whose root symbol is contained in Q C J 7 . The subterm relation is denoted as <j. Var(i) 
denotes the set of variables occurring in a term t and the size \t\ of a term is defined as 
the number of symbols in t. 

A term rewrite system ( TRS for short) 1Z over T(J-, V) is a finite set of rewrite rules 
I — > r, such that I ^ V and Var(Z) D Var(r). The smallest rewrite relation that contains 
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TZ is denoted by The transitive closure of -^n is denoted by — >i, and its transitive 
and reflexive closure by — We simply write — > for — if 7?- is clear from context. A 
term s € T(J-, V) is called a normal form if there is no f G 7~(JF, V) such that s — > t. 
With MJ-{TZ) we denote the set of all normal forms of a term rewrite system TZ. The 
innermost rewrite relation -^-ji of a TRS 7£ is defined on terms as follows: s -^n t 
if there exist a rewrite rule I — > r £ TZ, a context C, and a substitution a such that 
s = C[la], t = C[ro~], and all proper subterms of la are normal forms of TZ. The set of 
defined function symbols is denoted as T>, while the constructor symbols are collected in 
C. We call a term t = f(ti, ...,£„) basic if / G V and E T (C, V) for all 1 < i < n. A 
TRS 7£ is called duplicating if there exists a rule I^rGK such that a variable occurs 
more often in r than in I. We call a TRS terminating if no infinite rewrite sequence 
exists. Let s and £ be terms. If exactly n steps are performed to rewrite s to t we write 
s — > n t. The derivation length of a terminating term f with respect to a TRS 7£ and 
rewrite relation — is defined as: dl(s, — = max{n | 3t s — > n t}. Let TZ be a TRS 
and T be a set of terms. The runtime complexity function with respect to a relation — > 
on T is defined as follows: 

rc(n,T,->-) = max{dl(t,^) i e T and \t\ sC n} . 

In particular we are interested in the (innermost) runtime complexity with respect to 
-^11 {-^k) on the set Tt, of all basic terms, as defined abovecl More precisely, the 
runtime complexity function (with respect to TZ) is defined as rc-ji(n) := rc(n, 7b, — 
and we define the innermost runtime complexity function as rc^(n) := rc(n, 7b, -^t?.)- 
Finally, the derivational complexity function (with respect to TZ) becomes definable as 
follows: dc-ft(n) = rc(n,T,—i"ji), where 7~ denotes the set of all terms T{T, V). We 
sometimes say the (innermost) runtime complexity of TZ is linear, quadratic, or poly- 
nomial if rc^(n) is bounded linearly, quadratically, or polynomially in n, respectively. 
Note that the derivational complexity and the runtime complexity of a TRS TZ may 
be quite different: In general it is not possible to bound dc^ polynomially in rc-ji, as 
witnessed by Example 18.1.11 and the observation that the runtime complexity of TZ is 
linear (see Example 18.4.21 below). 

A proper order is a transitive and irreflexive relation and a preorder is a transitive 
and reflexive relation. A proper order >- is well-founded if there is no infinite decreasing 
sequence t\ y t% y- ■ ■ ■ . A well-founded proper order that also is a rewrite relation 
is called a reduction order. We say a reduction order y and a TRS TZ are compatible 
if TZ C >-. It is well-known that a TRS is terminating if and only if there exists a 
compatible reduction order. An ^-algebra A consists of a carrier set A and a collection 
of interpretations fj± for each function symbol in T. A well-founded and monotone 
algebra ( WMA for short) is a pair (A, >), where A is an algebra and > is a well-founded 
proper order on A such that every fj± is monotone in all arguments. An assignment 
a: V — > A is a function mapping variables to elements in the carrier. A WMA naturally 

2 We can replace % by the set of terms f(ti, . . . ,t„) with / G T>, whose arguments i; are in normal 
form, while keeping all results in this paper. 
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induces a proper order >_4 on terms: s >a t if [a]^(s) > for all assignments 

a: V -»• A. 

8.3 The Dependency Pair Method 

The purpose of this section is to take a fresh look at the dependency pair method 
from the point of complexity analysis. Familiarity with 0, [7^ will be helpful. The 
dependency pair method for termination analysis is based on the observation that from 
an arbitrary non-terminating term one can extract a minimal non-terminating subterm. 
For complexity analysis we employ a similar observation: From a given term t one can 
extract a list of subterms whose sum of the derivation lengths is equal to the derivational 
length of t. 

Let X be a set of symbols. We write C(t\, . . . , t n ) x to denote C[t\, . . . ,t n ], whenever 
root(tj) € X for all 1 ^ i ^ n and C is an n-hole context containing no X-symbols. 
(Note that the context C may be degenerate and does not contain a hole □ or it may be 
that C is a hole.) Then, every term t can be uniquely written in the form C{t\, . . . , t n ) x . 

Lemma 8.3.1. Let t be a terminating term, and let a be a substitution. Then we have 
d\{ta, ->n) = Eis^„ dl(ijcr, -^), whenever t = C(t 1: t n ) VuV . 

We define the function COM as a mapping from tuples of terms to terms as follows: 
COM(ti, . . . , t n ) is t\ if n = 1, and c(t±, . . . , t n ) otherwise. Here c is a fresh n-ary function 
symbol called compound symbol. The above lemma motivates the next definition of weak 
dependency pairs. 

Definition 8.3.1. Let t be a term. We set $ := t if t € V, and t$ := ft(ti, . . . ,t n ) if 
t = f(t\, . . . , t n ). Here /" is a new n-ary function symbol called dependency pair symbol. 
For a signature T, we define P = T U | / € J 7 }. Let K be a TRS. If I -> r € K 
and r = C(u\, . . . , u n ) VuV then the rewrite rule Z" — » COm(u5> • • ■ , Un) is called a uiea& 
dependency pair of 7£. The set of all weak dependency pairs is denoted by WDP(7£). 

While dependency pair symbols are defined with respect to WDP(7£), these symbols 
are not defined with respect to the original system 1Z. In the sequel defined symbols, 
refer to the defined function symbols of 1Z. 

Example 8.3.1 (continued from Example 18. 1.1|) . The set WDP(7£) consists of the next 
seven weak dependency pairs: 

5: is.empty^nil) — > c 

6: is_empty"(a; :: y) — ► d 

7: hd a (x::y) — ► x 

8: t\\x::y)^y 

Lemma 8.3.2. Let t € T(J-,V) be a terminating term with root(i) E T>. We have 
dl(t, = dl(^, ^wdp(-r.)u^)- 



9: appendix, y) — > ifappend^x, y, x) 

10: ifappend^(x, y, nil) — > y 
11 : ifappend^(x, y, u :: v) — > e(u, append"(t>, y)) 



105 



8 Automated Complexity Analysis Based on the Dependency Pair Method 



Proof. We show dl(i, — < dl(i", ^wdp(^)u^) by induction on £ = d\(t, —>n). If £ = 0, 
the inequality is trivial. Suppose £ > 0. Then there exists a term u such that t —>n u 
and dl(u, = £ — 1. We distinguish two cases depending on the rewrite position p. 

- If p is a position below the root, then clearly root (it) = root(t) G 2? and t" — it". 
The induction hypothesis yields d\(u,—>n) ^ dl(u", — ►wdp^utj)) an d we obtain 
£ ^ dl(i", ^\NDP(K)un)- 

- If p is a root position, then there exist a rewrite rule Z — > r € 72. and a substitution 
a such that t = la and it = re We have r = C(ui, . . . , i*n)x>uy an< ^ thus by 
definition Z" -> COM(w|, . . . , ui) G WDP(72) such that t" = Z"o\ Now, either u, 6 V 
or root(iij) G I? for every 1 ^ i n. Suppose Ui G V. Then u\o~ = UjO" and clearly 
no dependency pair symbol can occur and thus, 

6\{uia,^n) = d\{u\a,^Ti) = dl((u^cr) 11 , ^wdp(^)u^) • 

Otherwise, if root(uj) G V then u\a = (uia)K Hence dl(ujcr, ^ d\(u, < I, 
and we conclude dl(uj<7, — >n) ^ dl(u"<7, ^wDP(7e)u7^) horn the induction hypothesis. 
Therefore, 

£ = dl(u,-*rc) + l= dl(uiff,-^j) + l< dl(«}<7, ^wdp(^)u^) + 1 

< dl(coM(n|, . . . , ujjjcr, ^wDP(^)u7e) + 1 = dl(t s , ^wdp(^)u^) • 

Here we used Lemma 18.3.11 for the second equality. 

Note that t is 72-reducible if and only if t* is WDP(72) U 72-reducible. Hence as t is termi- 
nating, t" is terminating on ^wDP(TC)uft- Thus, similarly, dl(t, ->^) ^ dl(i", ->wDP(ft)uft) 
is shown by induction on dl(i", ^wDP(7e)u^)- ^ 

Lemma 8.3.3. Let t be a terminating term and a a substitution such that xa is a 
normal form of 72 for all x G Var(i). Then dl(i<7, — = Xa<i<n dl(tjO", — >7e), whenever 
t = C(ti, . . . , t n )jj. 

Definition 8.3.2. Let 72 be a TRS. If I — > r G 72 and r = C{u\, . . . ,u n ) v then the 
rewrite rule Z" — ► COm(m" , . . . , i4l) is called a weafc innermost dependency pair of 72. The 
set of all weak innermost dependency pairs is denoted by WIDP(72). 

Example 8.3.2 (continued from Example 18. 1 . If) . The set WIDP(72) consists of the 
following seven weak dependency pairs (with respect to - L >): 

is_empty"(nil) — » c append" (a;, y) — » ifappend"(x, y, x) 

is_empty"(x :: y) — > d ifappend"(x, y, nil) — > g 

hd"(x :: y) — » e ifappend"(x, y, n :: u) — > append"(v,y) 
tl*(x :: y) -> f . 
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The next lemma adapts Lemma 18.3.21 to innermost rewriting. 

Lemma 8.3.4. Let t be an innermost terminating term in T(J-,V) with root(t) G T>. 
We have dl(i,^) = dl(t tt , -^widp^utj)- 

We conclude this section by discussing the applicability of standard dependency pairs 
(0j) in complexity analysis. For that we recall the standard definition of dependency 
pairs. 

Definition 8.3.3 ([9]). The set DP(7£) of (standard) dependency pairs of a TRS 1Z is 
defined as {7" — > v$ \ I — > r G 1Z, u < r, root(it) G £>}. 

The following example shows that Lemma 18.3.21 (Lemma I8.3.4D does not hold if we 
replace weak (innermost) dependency pairs with standard dependency pairs. 

Example 8.3.3. Consider the one-rule TRS K: f(s(x)) -> g(f(x), f(x)). DP (ft) is the 
singleton of f"(s(x)) — ► f"(x). Let i n = f(s n (x)) for each n ^ 0. Since i n+ i — ^ g(t n ,t n ) 
holds for all n ^ 0, it is easy to see dl(t n+ i, — ^ 2 n , while dl(i^ +1 , ^dp(7£)u7£) = n - 

Hence, in general we cannot replace weak dependency pairs with (standard) depen- 
dency pairs. However, if we restrict our attention to innermost rewriting, we can employ 
dependency pairs in complexity analysis without introducing fallacies, when specific 
conditions are met. 

Lemma 8.3.5. Let t be an innermost terminating term with root(t) G T>. If all com- 
pound symbols in WIDP(ft) are miliary, dl(i, -^n) ^ dl(t", -^dp(7J)u7j) + 1 holds. 

Example 8.3.4 (continued from Example I8.3.2|) . The occurring compound symbols are 
nullary. DP(ft) consists of the following two dependency pairs: 

appendix, y) — > ifappend^(x, y, x) ifappend^(x, y, u :: v) — > append"^ , y) . 

8.4 Usable Rules 

In the previous section, we studied the dependency pair method in the light of complexity 
analysis. Let ft be a TRS and V a set of weak dependency pairs, weak innermost 
dependency pairs, or standard dependency pairs of ft. Lemmata 18.3.21 18.3.41 and 18.3.51 
describe a strong connection between the length of derivations in the original TRSs ft 
and the transformed (and extended) system "P U ft. In this section we show how we can 
simplify the new TRS V U ft by employing usable rules. 

Definition 8.4.1. We write / >d 9 if there exists a rewrite rule / — > r G ft such that 
/ = root(Z) and g is a defined function symbol in Tux\(r). For a set Q of defined function 
symbols we denote by 7t\Q the set of rewrite rules I — > r G ft with root(Z) G Q. The 
set U{t) of usable rules of a term t is defined as 1Z\{g | / >^ g for some / G J r un(t)}. 
Finally, if V is a set of (weak) dependency pairs then U(V) = Uz^re-p^ 7 *)- 
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Example 8.4.1 (continued from Examples 18.3.11 and 18.3/2]) . The sets of usable rules 
are empty (and thus equal) for the weak dependency pairs and for the weak innermost 
dependency pairs, i.e., we have U(\NDP(TZ)) = W(WIDP(ft)) = 0. 



The usable rule criterion in termination analysis (cf. [62J, [72j) asserts that a non- 
terminating rewrite sequence of TZ U DP (TZ) can be transformed into a non-terminating 
rewrite sequence of U(DP(TZ)) U DP(1Z) U {g(x,y) — > x,g(x,y) — > y}, where g is a fresh 
function symbol. Because U(DP(TZ)) is a (small) subset of TZ and most termination 
methods can handle g(x, y) — > x and g(x, y) — > y easily, the termination analysis often 
becomes easy by switching the target of analysis from the former TRS to the latter 



TRS. Unfortunately the transformation used in [62j, l72| increases the size of starting 



terms, therefore we cannot adopt this transformation approach. Note, however that the 



usable rule criteria for innermost termination [57|] can be directly applied in the context 
of complexity analysis. Nevertheless, one may show a new type of usable rule criterion 
by exploiting the basic property of a starting term. Recall that 7t> denotes the set of 
basic terms; we set Ig = \ t G T^}. 

Lemma 8.4.1. Let V be a set of (weak) dependency pairs and let (ti)i=o,i,... be a (finite 
or infinite) derivation of TZ U V. If to £ 1\j then (tj)i=o,i,... is a derivation of U(V) U V . 

Proof. Let Q be the set of all non-usable symbols with respect to V . We write P(t) 
if t\ q G NT(TZ) for all q G Vosg(t). Since U —>uCP)uv h+1 holds whenever P(ti) and 
U -^Tluv ti+i, it is sufficient to show P(ti) for all i. We perform induction on i. 

(i) Assume i = 0. Since to € T^, we have to € NF(TZ) and thus t\ p G AAJ^(7^) for all 
positions p. The assertion P follows trivially. 

(ii) Suppose i > 0. By induction hypothesis, there exist I — > r G ^(T 7 ) U "P, p G 
■Pos(tj_i), and a substitution cr such that = Icr and = rcr. In order to 
show property P for tj, we fix a position q £L Q. We have to show G NFiTZ). 
We distinguish three cases: 

- Suppose that q is above p. Then is reducible, but this contradicts the 
induction hypothesis P(ij_i). 

- Suppose p and q are parallel but distinct. Since ti-\\ q = ti\ q G NF{TZ) holds, 
we obtain P(ti). 

- Otherwise, q is below p. Then, t^L is a subterm of rcr. Because r contains 
no (/-symbols by the definition of usable symbols, ti\ q is a subterm of xa for 
some x G Var(r) C Var(Z). Therefore, is also a subterm of tj-i, from which 

G MT(TZ) follows. We obtain P(^). 

□ 

The following theorem follows from Lemmata 18.3.21 18.3.41 and 18.3.51 in conjunction 
with the above Lemma 18.4.11 It adapts the usable rule criteria to complexity analysis!! 



Note that Theorem 18.4.11 only holds for basic terms t G . In order to show this, we need some 
additional technical lemmas, which are the subject of the next section. 
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Theorem 8.4.1. Let 1Z be a TRS and let t € If t is terminating with respect to — > 
then dl(i, — ►) ^ dl(i&, — ^(TMup)) where — > denotes — or depending on whether 

V = WDP(ft) orP = WIDP(7£). Moreover, suppose all compound symbols in WIDP(fc) 
are nullary then dl(i,^) d\($, -^u(DP{K)) uDP(n)) + 1- 

It is worth stressing that it is (often) easier to analyse the complexity of IA{V) U V than 
the complexity of 1Z. To clarify the applicability of the theorem in complexity analysis, 
we consider two restrictive classes of polynomial interpretations, whose definitions are 
motivated by 

A polynomial P(x±, . . . ,x n ) (over the natural numbers) is called strongly linear if 
P(xi, . . . , x n ) = x\ + • • • + x n + c where c S N. A polynomial interpretation is called 
linear restricted if all constructor symbols are interpreted by strongly linear polynomials 
and all other function symbols by a linear polynomial (monotone with respect to the 
standard order > on N). If on the other hand the non-constructor symbols are interpreted 
by quadratic polynomials, the polynomial interpretation is called quadratic restricted. 
Here a polynomial is quadratic if it is a sum of monomials of degree at most 2. It is easy 
to see that if a TRS 1Z is compatible with a linear or quadratic restricted interpretation, 
the runtime complexity of 1Z is linear or quadratic, respectively (see also [26|). 

Corollary 8.4.1. Let 1Z be a TRS and let V = WDP(^) or V = WIDP(ft). If U(P) U 

V is compatible with a linear or quadratic restricted interpretation, the (innermost) 
runtime complexity function rc^ with respect to 7Z is linear or quadratic, respectively. 
Moreover, suppose all compound symbols in WIDP(7£) are nullary and U(DP(1Z)) U 
DP (1Z) is compatible with a linear (quadratic) restricted interpretation, then 1Z admits 
at most linear (quadratic) innermost runtime complexity. 

Proof. Let 1Z be a TRS. For simplicity we suppose V = WDP(7£) and assume the 
existence of a linear restricted interpretation A, compatible with U(V) LiV. Clearly this 
implies the well-foundedness of the relation -^uivyjPi which in turn implies the well- 
foundedness of cf. Lemma f8.4.11 Hence Theorem l8.4.1l is applicable and we conclude 
d\(t, — >n) ^ dl(i", — >vvdp(7J)u7j)- O n the other hand, compatibility with A implies that 
dl(t«, 

^wdp(7£)u7?.) = 0(l*"D- A s 1^1 = 1*1) we can combine these equalities to conclude 
linear runtime complexity of 1Z. □ 

The below given example applies Corollary 18.4.11 to the motivating Example 18.1.11 
introduced in Section [8.11 

Example 8.4.2 (continued from Example 18.3.11 ). We take a quadratic restricted inter- 
pretation B into N \ {0} with eg = dg = nilg = 1, ejg(x,y) = x + y, x ::# y = x + y, 
hd^(x) = x + 1, tljg(aj) = x + 1, is_emptyg(x) = x + 1, appendix, y) = x 2 + 3x + y + 1, 
and ifappend^(x, y,z) = 2x + y + z 2 + z. Then B interprets WDP(7£) as follows: 

5: 2 > 1 8: x + y + l>y 

6: x + y + l>l 9: x 2 + 3x + y + 1 > 3x + y + x 2 

7: x + y + l>x 10: 2x + y + 2>y 

11 : 2x + y + u 2 + 2uv + v 2 + u + v >u + v 2 + 3v + y + l 
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Therefore, WDP(7£) Q >b holds. Hence, the runtime complexity of 1Z for full rewriting 
is quadratic. (Recall that U(\NDP(TZ)) = 0.) 



8.5 The Weight Gap Principle 

We recall the notion of relative rewriting ([53L 137t |). 



Definition 8.5.1. Let 1Z and S be TRSs. We write ^n/s f° r ~>s ' ■ ~^*s an d we 
call -^>u/s the relative rewrite relation of 1Z over 50 

Since dl(i, —*nis) corresponds to the number of — >-^.-steps in a maximal derivation of 
— >lluS from t, we easily see the bound dl(i, — >njs) ^ dl (t, — ^us)- in this section we 
study the opposite, i.e., we figure out a way to give an upper-bound of dl(i, — >7jus) by a 
function of dl(i, -^>n/s)- 

First we introduce the key ingredient, strongly linear interpretations, a very restric- 
tive form of polynomial interpretations. Let J- denote a signature. A strongly linear 
interpretation (SLI for short) is a WMA (A, >-) that satisfies the following properties: 
(i) the carrier of A is the set of natural numbers N, (ii) all interpretation functions f A 
are strongly linear, (hi) the proper order >- is the standard order > on N. Note that an 
SLI A is conceivable as a weight function. We define the maximum weight M A of A as 
max{/_4(0, . . . , 0) [ / € J 7 }. Let A denote an SLI, let ao denote the assignment mapping 
any variable to 0, i.e., ao(x) = for all x G V, and let t be a term. We write [t] as an 
abbreviation for [«o]^(^)- 

Lemma 8.5.1. Let A be an SLI and let t be a term. Then [t] ^ M_4 • \t\ holds. 

Proof. By induction on t. If t G V then [t] = ^ M_4 • \t\. Otherwise, suppose t = 
f(ti, . . . , t n ), where . . . , x n ) = x\ + . . . + x n + c. By the induction hypothesis and 

c ^ M^4 we obtain the following inequalities: 

M = fA([h],...,[tn}) < [tl] + --- + [tn}+C 

^M A -\h\ + --- + M A - \t n \ + = IVU • \t\ . 

□ 



The conception of strongly linear interpretations as weight functions allows us to study 
(possible) weight increase throughout a rewrite derivation. This observation is reflected 
in the next definition. 

Definition 8.5.2. Let A be an algebra and let 7Z be a TRS. The weight gap A(A,TZ) 
of A with respect to 1Z is defined on N as follows: A(^4, TV) = max{[r] — [I] \ I — ► r £ 7Z}, 
where — is defined as usual: m — n := max{m — n, 0} 

The following weight gap principle is a direct consequence of the definitions. 
4 Note that — ►•r./s = —*n, if <S = 0. 
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Lemma 8.5.2. Let 1Z be a non-duplicating TRS and A an SLI. If s t then [s] + 

A(A,n)^[t]. 

We stress that the lemma does only require the non-duplicating condition. Indeed, 
the implication in the lemma holds even if the TRS 1Z is not compatible with a strongly 
linear interpretation. This principle brings us to the next theorem. 

Theorem 8.5.1. Let TZ and <S be TRSs, A an SLI compatible with S and 1Z non- 
duplicating. Then we have dl(i, ^nus) ^ (1 + A(.4, TZ)) -dl(t, — ►■ws) + M^- \t\, whenever 
t is terminating on TZ U S. 

Proof. Let m = dl(t, ), let n = and set A = A(^4,72.). Any derivation of ^-^us 

is representable as follows 

•SO to Si ^ 5 £i — ■ • • tm ' 

and without loss of generality we may assume that the derivation is maximal. We observe 
the next two facts. 

(a) hi ^ [si] — [ti] holds for all ^ i ^ m. This is because [s] ^ [t] + 1 whenever s — >s t 
by the assumption S C >^, and we have Sj — \s fcl ij. 

(b) [sj+i] — [tj] ^ A holds for all ^ i < m as due to Lemma 18.5.21 we have [ij] + A ^ 
[si+l]- 

We obtain the following inequalities: 

dl(s , ->mj«s) =m + k -\ 1- k m 

^ m + ([s ] - [to]) + ■■■ + ([%] - [t m ]) 

= m+ [s ] + (M - [t ]) + • • • + ([s m ] - [tm-l]) ~ [t m ] 

< m + [s ] + m-A - [t m ] 
^ m + [so] + raA 

^ m + M_4 • n + mA = (1 + A)m + • n . 

Here we used (a) m-times in the second line, (b) m — 1-times in the fourth line, and 
Lemma l8.5.1l in the last line. □ 

The next example clarifies that the conditions expressed in Theorem 18.5.11 are essen- 
tially optimal: We cannot replace the assumption that the algebra A is strongly linear 
with a weaker assumption: Already if A is a linear polynomial interpretation, the deriva- 
tion height of 1Z U S cannot be bounded polynomially in dl(i, -^n/s) an d \t\ alone. 

Example 8.5.1. Consider the TRSs 1Z 

exp(O) -> s(0) d(0) -» 

exp(r(x)) — » d(exp(x)) d(s(x)) — > s(s(d(x))) 
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This TRS formalises the exponentiation function. Setting t n = exp(r n (0)) we obtain 
dl(i n , — ^ 2 n for each n 0. Thus the runtime complexity of 1Z is (at least) ex- 
ponential. In order to show the claim, we split 1Z into two TRSs 1Z\ = {exp(0) — > 
s(0),exp(r(x)) -> d(exp(x))} and "K 2 = {d(0) -> 0,d(s(x)) -» s(s(d(x)))}. Then it is easy 
to verify that the next linear polynomial interpretation A is compatible with 7^2 : 0^ = 0, 
d.4(x) = 3x, and s^(x) = x + 1. Moreover an upper-bound of dl(i n , — ►■r, 1 /'r. 2 ) can be es- 
timated by using the following polynomial interpretation £>: 0g = 0, dg^) = sg(x) = x, 
and expg(x) = rg(x) = a; + 1. Since — C >g and — ^ C ^ B hold, we have 
-^/Ka ^ >S- Hence dl(t n , -^/^J ^ [ao]s(tn) = n + 2. But clearly from this 
we cannot conclude a polynomial bound on the derivation length of 1Z\ U 7^2 = TZ, as 
the runtime complexity of 1Z is exponential, at least. 

To conclude this section, we show that Theorem 18.4.11 can only hold for basic terms 

t e rl 



Example 8.5.2. Consider the one-rule TRS 1Z = {a(b(x)) -> b(b(a(x)))} from [13fil . 
Example 2.50]. It is not difficult to see that dl(a n (b(x)), -> n ) = 2 n - 1, see 0. The 
set WDP(7£) consists of just one dependency pair a"(b(x)) — > a"(x). In particular the 
set of usable rules is empty. The following SLI A is compatible with WDP(7£): aj^(x) = 
3a( x ) = ^ an d b^(x) = x + 1. Hence, due to Lemma [H3j] we can conclude the existence 
of a constant K such that dl(i", — ►wdp(tj)) ^ ^ ' 1^1- Due to Theorem 18.4.11 we conclude 
linear runtime complexity of 1Z. 



8.6 Reduction Pairs and Argument Filterings 

In this section we study the consequences of combining Theorem l8.4.1l and Theorem l8.5.1l 
In doing so, we adapt reduction pairs and argument filterings ([9(]) to runtime complexity 
analysis. Let TZ be a TRS, and let A be a strongly linear interpretation and suppose 
we consider weak, weak innermost, or (standard) dependency pairs V, such that V is 
non-duplicating. If U(V) C >^ then there exist constants K, L ^ (depending on V 
and A only) such that 

d\(t,^ n )^K-d\(t\^ v/uiv) )+L-\tt\ , 

for all terminating basic terms t € 7b- This follows from the combination of Theo- 
rems 18.4.11 and 18.5.11 Thus, in order to estimate the derivation length of t with respect 
to TZ it suffices to estimate the maximal V steps, i.e., we have to estimate dl(t", —>v/U{V)) 
suitably. Consider a maximal derivation (t i ) i=0 .... >ri of —t-p/ucp) with *o = F° r every 
^ i < n there exist terms Ui and Uj such that 

Let > and >- be a pair of orders with > • y ■ > C y. If t, > Uj y V{ > ti + \ holds for all 
^ i < n, we obtain f" = to y t\ y ■ ■ ■ y t n . Therefore, dl(t", —*t>/u(t>)) can be bounded 
in the maximal length of ^-descending steps. We formalise these observations through 
the use of reduction pairs and collapsible orders. 
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Definition 8.6.1. Let 72 be a TRS, let V be a set of weak dependency pairs of 72 and 
let G denote a mapping associating a term (over J-* and V) and a proper order y with 
a natural number. An order y on terms is G- collapsible for a TRS 72. if s -^vuU(V) * 
and s >- t implies G(s, >-) > G(t, >-). An order >- is collapsible for a TRS 72, if there is a 
mapping G such that >- is G-collapsible for 72. 

Note that most reduction orders are collapsible. For instance, if A is a polynomial 
interpretation then >_4 is collapsible, as witnessed by the evaluation function [aoLl- 
Fur t herm ore, simplification orders like MPO, LPO and KBO are collapsible (cf. 771 . 
]3,[npnl5l 



Definition 8.6.2. A rewrite preorder is a preorder on terms which is closed under 
contexts and substitutions. A reduction pair (>,>-) consists of a rewrite preorder > and a 
compatible well-founded order y which is closed under substitutions. Here compatibility 
means the inclusion > • >- • > C y. A reduction pair (>, >-) is called collapsible for a 
TRS 72 if y is collapsible for 72. 

Recall the derivation in (|8.1f) : Due to compound symbols the rewrite step it, —>-p V{ 
may take place below the root. Hence V C y does not ensure Uj y V{. To address this 
problem we introduce a notion of safety that is based on the next definitions. 

Definition 8.6.3. The set is inductively defined as follows (i) T'uTC t}, where 
= {i^ | t € T} and (ii) c{t\,...,t n ) G Tc, whenever t%, . . . ,t n S Tc and c is a 
compound symbol. 

Definition 8.6.4. A proper order y on Tc is called safe if c(si, . . . , s,, . . . , s n ) y 
c(si, . . . , t, . . . , s n ) for all n-ary compound symbols c and all terms si, . . . , s n , t with 
Si y t. A reduction pair (>, y) is called safe if y is safe. 

Lemma 8.6.1. Let V be a set of weak, weak innermost, or standard dependency pairs, 
and let (>, y) be a safe reduction pair such that U{V) C > and T 3 C >-. If s € 7^" and 
s —*t>/u(v) t then s >- i and t £T C K 

Employing Theorem 18.4.11 Theorem 18.5.11 and Lemma 18.6.11 we arrive at our Main 
Theorem. 

Theorem 8.6.1. Let 72 be a TRS, let A be an SLI, let V be the set of weak, weak 
innermost, or (standard) dependency pairs, such that V is non-duplicating, and let 
(>, y) be a safe and G-collapsible reduction pair such that U(V) C > and V C y. If 
in addition U(V) C >_4 then for any i G 7b; we have dl(i, — >) ^ p(G(P, y), \t\), where 
p(m, n) := (1 + A(^4, V)) ■ m + M_4 • n and — > denotes — >tj or depending on whether 
V = WDP(72) or V = WIDP(72). Moreover if all compound symbols in WIDP(72) are 
miliary we have dl(t, -^) < p(G(^, ^), |i|) + 1. 



5 On the other hand it is easy to construct non-collapsible orders: Suppose we extend the natural 
numbers N by a non-standard element oo such that for any n 6 N we set oo > n. Clearly we cannot 
collapse oo to a natural number. 
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Proof. First, observe that the assumptions imply that any basic term t G 7t, is terminat- 
ing with respect to 7Z. This is a direct consequence of Lemma 18.4.11 and Lemma 18.6.11 in 
conjunction with the assumptions of the theorem. Without loss of generality, we assume 
V = \NDP(V). By Theorem EXH and [833] we obtain: 

d\(t,^)^d\^,^ u{v)uv ) ^p{6\{t\^ v/u{v) ),\t*\) 
< p(G(t^ y), |t*|) = p(G(i tt , y), \t\) . 

In the last line we exploit that = \t\. □ 

Note that there exist two subtle disadvantages of Theorem 18.6.11 in comparison to 
Theorem 18.4.11 First the Main Theorem requires that the set of weak, weak innermost, 
or (standard) dependency pairs V is non-duplicating. Second, the requirement that the 
usable rules are compatible with some SLI, implies that all usable rules must be non- 
duplicating. Hence the set U{V) U V must not contain duplicating rules. This is not 
necessary to meet the requirements of Theorem 18.4.11 

In order to construct safe reduction pairs one may use safe algebras, i.e., weakly mono- 
tone well-founded algebras (^4, y) such that the interpretations of compound symbols 
are strictly monotone with respect to y. Another way is to apply an argument filtering 
to a reduction pair. 

Definition 8.6.5. An argument filtering for a signature J- is a mapping tt that assigns 
to every n-ary function symbol / € J- an argument position i £ {1, . . . , n} or a (possibly 
empty) list . . . , i m ] of argument positions with 1 ^ i\ < • • • < i m ^ n. The signature 
J- n consists of all function symbols / such that 7r(/) is some list . . . ,i m ], where in 
J- n the arity of / is m. Every argument filtering tt induces a mapping from T{J-, V) to 
T(jT 7r , V), also denoted by tt: 



TT(t) 



t if t is a variable 

Tr(ti) if t = f(ti, . . . ,t n ) and 7r(/) = i 

J{n(Ui),- ■ ■ XO) if t = f(h,---,tn) and vr(/) = [ii,. 



An argument filtering tt is called safe if tt(c) = [1, . . . , n] for all n-ary compound symbols. 
For a relation R on T(T, V) we define R n on T(^ r 7r , V) as follows: s Ft* t if and only if 

Tt(s) R TT(t). 

Lemma 8.6.2. If (A, y) is a safe algebra then (^,4, y a) is a safe reduction pair, where 
y denotes the reflexive closure of y. Furthermore, (> 7r , >- 7r ) is a safe reduction pair if 
(~) 'y) i s a s& f e reduction pair and tt is a safe argument filtering. 

Following the pattern of the proof of Corollary 18.4.11 it is an easy exercise to extend 
Theorem 18.6. II to a method for complexity analysis. 

Corollary 8.6.1. Let 1Z be a TRS, let A be an SLI, let V be the set of weak, weak 
innermost, or standard dependency pairs, such that V is non-duplicating, where the 
compound symbols in WIDP(7?.) are nullary, if V = DP(1Z). Moreover let B be a linear 



114 



8.7 Experiments 



or quadratic restricted interpretation such that (^b,>b) forms a safe reduction pair 
with U(V) C and V C >_g. If U(V) Q >a then the (innermost) runtime complexity 
function rc^ with respect to 1Z is linear or quadratic, respectively. 

Note that if U{V) = 0, the compatibility of U{V) with an SLI is trivially satisfiable. 
In this special case by taking the SLI A that interprets all symbols with the identity 
function, we obtain dl(t, — >) ^ G(i", >b) + \t\ because A (.4, 0) = and = 1. 

As a consequence of Theorem 18.6.11 and Lemma f8.3.5l we obtain the following corollary. 

Corollary 8.6.2. Let 1Z be a TRS, let A be an SLI, let all compound symbols in 
WIDP(7£) be miliary, let WIDP(7£) be non-duplicating, and let B be a linear or quadratic 
restricted interpretation such that (^s> >s) forms a reduction pair with £Y(DP(7£)) C 
and DP (1Z) C >g. If in addition W(DP (72-)) C >^ then the innermost runtime complexity 
function rc^ with respect to 1Z is linear or quadratic, respectively. 

Corollary 18.6.21 establishes (for the first time) a method to analyse the derivation 
length induced by the standard dependency pair method for innermost rewriting. More 
general, if all compound symbols in WIDP(7£) are miliary and there exists a collapsible 
reduction pair (>, >-) such that U{V) C > and V C then the innermost runtime 
complexity of 7^. is linear in the maximal length of ^-descending steps. Clearly for string 
rewriting (cf. [l37 ]) the compound symbols in WIDP(7£) are always nullary and all rules 



in WIDP(7£) are non-duplicating. Hence the syntactic requirements are always met. 



8.7 Experiments 

In order to test the practical feasibility of the here established methods, we implemen- 
tated a complexity analyser based on syntactical transformations for dependency pairs 
and usable rules together with polynomial orders (based on [3]). To deal efficiently with 
polynomial interpretations, the issuing constraints are encoded in propositional logic in 



a similar spirit as in 51]. Assignments are found by employing a state-of-the-art SAT 
solver, in our case MiniSalUl. Furthermore, strongly linear interpretations are handled 
by a decision procedure for Presburger arithmetic. 

In a similar way, the new techniques have also been incorportated into the Tyrolean 
Complexity Tool (TqV for short) that incorporates the most powerful techniques to anal- 
yse the complexity of rewrite systems that are currently at hand0 For compilation of 
the here presented experimental data we used the latter implementation. 

As suitable test bed we used the rewrite systems in the Termination Problem Data 
Base version 4.0H This test bed comprises 1739 TRSs. The presented tests were per- 
formed on a server with 8 Dual-Core 2.6 GHz AMD® Opteron™ Processor 8220 CPUs, 
for a total of 16 cores. 64 GB of RAM are available. For each system we used a timeout 
of 60 seconds, the times in the tables are given in seconds. Tables IBTTI and [8^21 summarise 



6 http : //minis at . se/ | 

7 http : // cl-inf ormatik.uibk. ac . at/sof tware/tct/| 



http : // colo5-c703 .uibk. ac . at : 8080/termcomp/ 
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Table 8.1: Results for Linear Runtime Complexities 



full rewriting innermost rewriting 





LR 


Cor.|8AUCor. 


18.6.11 both 


Cor. 18.4.11 


(DP) C01 


-.18.6.11 


(DP) both 


s 


139 


139 


93 147 


144 


(136) 


102 


(91) 166 




7 


9 


14 31 


8 


(7) 


16 


(13) 33 


F 


1591 


1582 


1646 1587 


1577 


(1581) 


1637 


(1648) 1568 




2474 


4789 


456 3853 


4699 


(4797) 


462 


(455) 3628 


T 


8 


17 


5 


17 


(22) 





(0) 5 



Table 8.2: Results for Quadratic Runtime Complexities 



full rewriting innermost rewriting 





QR 


Cor.l8AUCor. 


18.6.11 both 


Cor.l8.4.ll 


(DP) 


Cor.l8.6.ll 


(DP) both 


s 


182 


182 


93 186 


183 


(166) 


102 


(91) 193 




152 


329 


97 614 


324 


(327) 


98 


(81) 486 


F 


524 


473 


1636 564 


492 


(855) 


1627 


(1636) 577 




5469 


5436 


793 5215 


5500 


(4884) 


825 


(765) 5535 


T 


864 


951 


10 853 


924 


(884) 


10 


(12) 833 



the results of the conducted experiments Text written in italics below the number of 
successes or failures indicates total time of success cases or failure cases, respectively!^! 

We use the following abbreviations: The method LR (QR) refers to compatibility with 
linear (quadratic) restricted interpretation, cf. Section [8.31 Moreover "S", "F", "T" de- 
notes success, failure, or timeout respectively. In interpreting defined and dependency 
pair functions, we restrict the search to polynomials in the range {0, 1, . . . , 5}. Table [8TT1 
shows the experimental results for linear runtime complexities based on LR. The columns 
marked "Cor. [87431 ' and "Cor. [87671T refer to the applicability of the respective corollar- 
ies. In the column marked "both" we indicate the results, we obtain when we first try to 
apply Corollary 18 .6 . 1 1 and if this fails Corollarv l8.4.1i Table [8721 summarises experimental 
results for quadratic runtime complexities based on QR. On the studied test bed there 
are 1567 TRSs such that one may switch from WIDP(7£) to DP (1Z). For the individual 
tests, we indicated the results in parentheses for these versions of Corollary 18.4.11 and 
Corollary ESU 



8.8 Conclusion 

In this paper we studied the runtime complexity of rewrite systems. We have estab- 
lished a variant of the dependency pair method that is applicable in this context and is 
easily mechanisable. In particular our findings extend the class of TRSs whose linear 

9 For full experimental evide nce see |http : //www . jaist.ac.j p/~hirokawa/08a/ or 
|http : / /cl- inf ormat ik . uibk . ac . at/ sof tware/tct/ 

10 Sum of numbers in each column may be less than 1739 because of stack overflow. 
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or quadratic runtime complexity can be detected automatically. We provided ample nu- 
merical data for assessing the viability of the method. To conclude, we mention possible 
future work. In the experiments presented, we have restricted our attention to inter- 
pretation based methods inducing linear or quadratic (innermost) runtime complexity. 
Recently in (see Chapter [6]) a restriction of the multiset path order, called polynomial 
path order has been introduced that induces polynomial runtime complexity. In future 
work we will test to what extent this is effectively combinable with our Main Theorem. 
Furthermore, we strive to extend the approach presented here to handle dependency 
graphs [1]. 
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This paper builds on recent efforts (see Chapter[8|) to exploit the dependency pair method 
for verifying feasible, i.e., polynomial runtime complexities of term rewrite systems auto- 
matically. We extend our earlier results by revisiting dependency graphs in the context 
of complexity analysis. The obtained new results are easy to implement and consid- 
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data for assessing the viability of the method. 
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9.1 Introduction 

Term rewriting is a conceptually simple but powerful abstract model of computation 
that underlies much of declarative programming. Runtime complexity is a notion for 
capturing time complexities of functions defined by a te rm rewriting system (TRS for 



short) introduced in [74j (see Chapter [8] but also [106l . l26l . 111!]), In recent research 
we revisited the basic dependency pair method [9J in order to make it applicable for 
complexity analysis, cf. |74|. The dependency pair method introduced by Arts and 
Giesl 0] is one of the most powerful methods in termination analysis. The method 
enables us to use several powerful techniques including, usable rules, reduction pairs, 



argument filterings, and dependency graphs. Our main results in 74] show how natural 
improvements of the dependency pair method, like usable rules, reduction pairs, and 
argument filterings become applicable in the context of complexity analysis. In this 
paper, we will extend these recent results further. 

The dependency pair method for termination analysis is based on the observation 
that from an arbitrary non-terminating term one can extract a minimal non-terminating 
subterm. For that one considers dependency pairs that essentially encode recursive calls 
in a TRS. Note that with respect to the TRS defined in Example 19.1.11 b elow . one finds 
5 such pairs (see Section l9~4"1 for further details). 

Example 9.1.1. Consider the following TRS 1Z which computes a permutation of listsU 



app(nil,y) — > y 4: reverse(n :: x) — > app(reverse(x), n :: nil) 

app(n :: x, y) — > n :: app(x, y) 5: shuffle(nil) — > nil 

reverse(nil) — ^ n i I 6: shuffle(n :: x) — » n :: shuffle(reverse(x)) 



A very well-studied refinement of the dependency pair method are dependency graphs. 
To show termination of a TRS, it suffices to guarantee that none of the cycles in DG(7£) 0] 
can give rise to an infinite rewrite sequence. (Here a cycle C is a nonempty set of 
dependency pairs of TZ such that for every two pairs s — > t and u — > v in C there exists a 
nonempty path in C from s — > t to u — > v.) More precisely it suffices to prove for every 
cycle C in the dependency graph DG(JZ), that there are no C-minimal rewrite sequences 
(see 57], but also 7^, 62]). To achieve this one may consider each cycle independently, 



i.e., for each cycle it suffices to find a reduction pair (>,>-) (cf. Section |9T2|) such that 
TZ C >, C C > and C n >- ^ 0, i.e., at least one dependency pair in C is strictly 
decreasing. 

Example 9.1.2 (continued from Example 19. 1.1 j) . The dependency graph DG(7£), whose 
nodes are the mentioned 5 dependency pairs, has the following form 

a a 

10' — > 11' — ► 8' — >T 

W 

9' 



This is Example 3.12 in Arts and Giesl's collection of TRSs [Tol ] . 
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This graph contains the (maximal) cycles {7'}, {9'}, and {10'}H As already mentioned, 
it suffices to consider each of these three cycles individually. 

The main contribution of this paper is to extend the dependency graph refinement 
of the dependency pair method to complexity analysis. This is a challenging task, and 
we face a couple of difficulties, documented via suitable examples below. To overcome 
these obstacles we adapt the standard notion of dependency graph suitably and intro- 
duce weak (innermost) dependency graphs, based on weak dependency pairs, which have 



been studied in [7_4( (see also Chapter [8]). Moreover, we observe that in the context 
of complexity analysis, it is not enough to focus on the (maximal) cycles of a (weak) 
dependency graph. Instead, we show how cycle detection is to be replaced by path de- 
tection, in order to salvage the (standard) technique of dependency graphs for runtime 
complexity considerations. 

The remainder of the paper is organised as follows. After recalling basic notions in 
Section 19.21 we recall in Section 19.31 main results from [3] that will be extended in 
the sequel. In Section 19.41 we establish our dependency graph analysis for complexity 
analysis. Finally, we conclude in Section 19.51 where we assess the applicability of our 
method. 



9.2 Preliminaries 



We assume familiarity with term rewriting 15j, Il37| |. but briefly review basic concepts 



and notations. Moreover, we assume familiarity with standard notions in graph theory 
(see for example [HI, Chapter 1]). 

Let V denote a countably infinite set of variables and T a signature. The set of terms 
over T and V is denoted by T(J- ', V) (T for short). The root symbol of a term t is either 
t itself, if t G V, or the symbol /, if t = f(t±, . . . , t n ). The set of positions Vos(t) of a 
term t is defined as usual. We write Vosg{t) C 'Pos(t) for the set of positions of subterms 
whose root symbol is contained in Q C T . T he de scendants of a position with respect 
to a rewrite sequence are defined as usual, cf. [l37 |. The subterm relation is denoted as 



<!. Var(i) (.Fun(i)) denotes the set of variables (functions) occurring in a term t. The 
size \t\ of a term is defined as the number of symbols in t. A term rewrite system 7Z 
over T{T,V) is a finite set of rewrite rules I — » r, such that I £ V and Var(Z) D Var(r). 
The smallest rewrite relation that contains 1Z is denoted by — and its transitive and 
reflexive closure by — We simply write — > for — if 7£ is clear from context. A 
term s € T(J- ', V) is called a normal form if there is no t E 7~( T , V) such that s — > t. 
The innermost rewrite relation -^n of a TRS 1Z is defined on terms as follows: s -^n t 
if there exists a rewrite rule I — > r S TZ, a context C, and a substitution a such that 
s = C[la], t = C[ro~], and all proper subterms of la are normal forms of TZ. The set of 
defined symbols is denoted as T>, while the constructor symbols are collected in C. We 
call a term t = f{t\, . . . , t n ) basic if / G T> and t L 6 T(C, V) for all 1 ^ i ^ n. 

We call a TRS terminating if no infinite rewrite sequence exists. The n-fold composi- 
tion of — > is denoted as — > n and the derivation length of a terminating term t with respect 



Recall that a cycle C is maximal, if there is no longer cycle containing C. 
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to a TRS 1Z and rewrite relation — ^ is defined as: dl(s,— >tj) := max{n | 3i s — > n t}. 
Let 7?. be a TRS and T be a set of terms. The runtime complexity function with respect 
to a relation — > on T is denned as follows: 

rc(n, T, -»•) := max{dl(t, -»■) | t G T and |t| ^ n} . 

In particular we are interested in the (innermost) runtime complexity with respect to 
—>1Z (^tz) on the set Tt, of all basic termsQ More precisely, the runtime complex- 
ity function (with respect to 1Z) is defined as rc^(n) := rc(n, %>, — >ti) and we define 
the innermost runtime complexity function as rc^(n) := rc(n, -^n). Note that 
the derivational complexity function (with respect to 1Z) becomes definable as follows: 
dc-ji(n) := rc(n, T, — where T denotes the set of all terms T(J- ', V), compare [79(. We 
sometimes say the (innermost) runtime complexity of 1Z is linear, quadratic, or polyno- 
mial if rc^ is bounded by a linear, quadratic, or polynomial function in n, respectively. 

A proper order is a transitive and irreflexive relation and a preorder is a transitive 
and reflexive relation. A proper order y is well-founded if there is no infinite decreasing 
sequence t\ >- ti y- £3 ■ ■ ■ . An J 7 - algebra A consists of a carrier set A and an interpreta- 
tion /_4 for each function symbol in T. A well-founded and monotone algebra ( WMA for 
short) is a pair (A, >), where A is an algebra and > is a well-founded proper order on 
A such that every /_4 is monotone (with respect to >) in all arguments. An assignment 
a: V — > A is a function mapping variables to elements in the carrier, and [a]_4(-) denotes 
the usual evaluation function associated with A. A WMA naturally induces a proper 
order >_4 on terms: s >^ t if [a]^t(s) > [a]^i(i) for all assignments a: V — > A. For the 
reflexive closure ^ of >, the preorder is similarly defined. Clearly the proper order 
>_A is a reduction order, i.e., if 1Z C >_4, for a TRS 7£, then we can conclude termination 
of 7£. A rewrite preorder is a preorder on terms which is closed under contexts and 
substitutions. A reduction pair (;>,>-) consists of a rewrite preorder > and a compatible 
well-founded order y which is closed under substitutions. Here compatibility means the 
inclusion C Note that for any WMA .4 the pair (^.4, >.a) constitutes a 

reduction pair. 

We call a WMA .4 based on the natural numbers N a polynomial interpretation, if all 
functions fjs, are polynomials. A polynomial P{x\, . . . ,x n ) (over the natural numbers) 
is called strongly linear if P{x\, . . . , x n ) = x\ + • • • + x n + c where c € N. A polyno- 
mial interpretation is called linear restricted if all constructor symbols are interpreted 
by strongly linear polynomials and all other function symbols by linear polynomials. If 
on the other hand the non-constructor symbols are interpreted by quadratic polynomi- 
als, the polynomial interpretation is called quadratic restricted. Here a polynomial is 



quadratic if it is a sum of monomials of degree at most 2 (see 43j). It is easy to see 
that if a TRS 1Z is compatible with a linear or quadratic restricted interpretation, the 
runtime complexity of 1Z is linear or quadratic, respectively (see [iJ] but also (26|). 

Finally, we introduce a very restrictive class of polynomial interpretations: strongly 
linear interpretations {SLI for short). A polynomial interpretation is called strongly 



4 We can replace 7b by the set of terms /(ti, . . . ,t n ) with / £ T>, whose arguments i; are in normal 
form, while keeping all results in this paper. 
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linear if all functions / are interpreted as strongly linear polynomials. 



9.3 Complexity Analysis Based on the Dependency Pair 
Method 



In this section, we recall central definitions and results established in [7j| (see also 
Chapter [8]). We kindly refer the reader to [3] for additional examples and underlying 
intuitions. 

We write C(ti, . . . , t n ) x to denote C[ti, . . . , t n ], whenever root(tj) G X for all 1 ^ i ^ n 
and C is an n-hole context containing no X-symbols. Let t be a term. We set i" := t if 
t G V, and t* := /"(ti, • • • , t n ) if t = f(t\, . . . , t n ). Here /" is a new n-ary function symbol 
called dependency pair symbol. For a signature we define fl=J r l){fl \ f G JF}. 

Definition 9.3.1. Let 7?- be a TRS. If Z — > r G TZ and r = C(iti, . . . ,u n )-p uV then 
the rewrite rule Z" —* COm(u", . . . , Un) is called a weafc dependency pair of 7£. Here 
COM is defined with a fresh n-ary function symbol c (corresponding to I — > r) as fol- 
lows: 0OM(ii, . . . , t„) is ti if n = 1, and c(t±, . . . , t n ) otherwise. The symbol c is called 
compound symbol. The set of all weak dependency pairs is denoted by WDP(7£). 

Example 9.3.1 (continued from Example 19. 1.1)1 . The set WDP(7£) consists of the next 
6 weak dependency pairs. 

7: app" (nil, y) — > y 10: reverse"(n :: x) — » app"(reverse(x), n :: nil) 

8: app"(n :: x,y) — » c(n, app"(x,y)) 11: shufFle^ (nil) — > e 

9: reverse" (nil) — > d 12: shuffle" (n :: x) — > f (n, shuffle"(reverse(x))) 

Definition 9.3.2. Let TZ be a TRS. If / — > r G 7£ and r = C(ui, . . . ,u n ) v then the 
rewrite rule Z" — > COM(«" , . . . , ut.) is called a weaZc innermost dependency pair of 7£. The 
set of all weak innermost dependency pairs is denoted by WIDP(7^.). 

Definitions 19.3. ll and 19.3721 should be compared to the definition of "standard" depen- 
dency pairs. 

Definition 9.3.3 ([9]). The set DP(7£) of (standard) dependency pairs of a TRS TZ is 
defined as {/" —* it" | I — > r G TZ, u < r, root(u) G P}. 

Example 9.3.2 (continued from Example 19.3. 1|) . As already mentioned in the intro- 
duction, the TRS TZ admits 5 (standard) dependency pairs. Note that the sets DP(TZ) 
and WDP(7£) are incomparable. For example app"(nil,y) WDP(7£) \ DP(7£) while 

shuffle"(x)) -♦ reverse"^) G DP(7e) \ WDP(7e). 

We write / >d 9 if there exists a rewrite rule I -> r G such that / = root(Z) and g 
is a defined symbol in Tur\(r). For a set Q of defined symbols we denote by TZ\Q the set 
of rewrite rules I — > r G 7£ with root(Z) G The set U{t) of usable rules of a term t is 
defined as TZ\{g \ f >*±g for some / G J r un(t)}. Finally, if V is a set of (weak or weak 
innermost) dependency pairs then U{V) = \Ji^ re pU(r). 
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Proposition 9.3.1 (Chapter[8j Theorem [5X1]) . Let K be a TRS and let t G T b . If t is 

terminating with respect to — > then dl(i, — ►) ^ dl(f", — ►w('P) up)i where — > denotes — >n 
or -U^ depending on whether V = WDP(^) or V = WIDP(^). 



We recall the notion of relative rewriting [1371 ] . Let 7£ and 5 be TRSs. We write 
~*"R,/S f° r ' ' an d we call —>-r,/s the relative rewrite relation of 7£ over 5. 
(Note that —>n/s = - if <5 = 0-) Let *4 denote a strongly linear interpretation. 

Proposition 9.3.2 (Chapter [8j Theorem I8XTT) . Let 7£ and 5 be TRSs, .A an SLI 
compatible with S, and 7£ non-duplicating. There exist constants K and L, depending 
only on TZ and A, such that dl(t, — ►tjus) ^ ^ • d I (i , —>n/s) + L ■ \t\ for all terminating 
terms t on H U 5. 

We need some further definitions. Let 1Z be a TRS, let P be a set of weak or weak 
innermost dependency pairs of 7£ and let G denote a mapping associating a term (over 
J-^ and V) and a proper order y with a natural number. An order >- on terms is G- 
collapsible for a TRS 7Z if s —*'p\ju(V) * an d s ^~ t implies G(s, y) > G(t, y). An order y 
is collapsible for a TRS 1Z, if there is a mapping G such that >- is G-collapsible for T^H 

We write for {t" | t G 7b}- The set Tq is inductively defined as follows (i) T"uTC 
7j?, where T" = {i^ | t G T} and (ii) c(t\, . . . ,t n ) G 7|7, whenever t\, . . . ,t n G 7? and 
c a compound symbol. A proper order >- on T} is called sa/e if c(s\, . . . , s$, . . . , s n ) >~ 
c(si, . . . , t, . . . , s„) for all n-ary compound symbols c and all terms si,...,s n ,t with 
Si y t. A reduction pair (>, >-) is called collapsible for a TRS TZ if >- is collapsible for 7£. 
It is called safe if the well-founded order >~ is safe. In order to construct safe reduction 
pairs one may use safe algebras, i.e., weakly monotone well-founded algebras (A, y) such 
that the interpretations of compound symbols are strictly monotone with respect to y. 
It is easy to see that if (A, >) is a safe algebra then (^.4, >a) is a safe reduction pair. 

Proposition 9.3.3 (Chapter [8j Theorem EH]) • Let K be a TRS, let A be an SLI, let 
V be a set of weak or weak innermost dependency pairs, such that V is non-duplicating, 
and let (>, y) be a safe and G-collapsible reduction pair such that U(V) C > and V C y. 
If in addition U(V) C >^ then for any t G 7b, there exist constants K and L (depending 
only on 1Z and A) such that dl(t, — >) ^ K ■ G(i", >-) + L- |t|. Here — > denotes — ><jz or 
depending on whether V = \NDP(TZ) or V = WIDP(Te). 

Suppose the assertions of the proposition are met and there exists a polynomial p such 
that G(tt,y) ^ p(\t\) holds. Then, as an easy corollary to Proposition I9.3.31 we observe 
that the runtime complexity induced by TZ is majorised by p. 



9.4 Dependency Graphs 

In this section, we study a natural refinement of the dependency pair method, namely 
dependency graphs (see 0, [H3, H^, 0|) in the context of complexity analysis. We start 

5 Note that most reduction orders are collapsible. E.g. if A is a polynomial interpretation then >a is 
collapsible, as one may take any a and set G(t, >a) '■= [a]A(t)- 
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with a brief motivation. Let ft be a TRS, let V denote a set of weak or weak innermost 
dependency pairs and let (si)i=o,...,n denote a maximal derivation D with respect to ft 
with so G T[,. In order to estimate the length £ of this derivation it suffices to estimate 
the length of the derivation to ~^*u(V)\JP w here *o = s Q € T^, cf. Proposition 19.3.11 If 
we suppose that V is non-duplication and that there exists an SLI such that U{V) C A, 
we may estimate the derivation length i by finding one (safe and collapsible) reduction 
pair (>, >-) such that i/(ft) C > and V Q >~ holds, cf. Proposition 19.3.31 On the other 
hand in termination analysis — as already mentioned in the introduction — it suffices to 
guarantee that for any cycle C in the dependency graph DG(ft), there are no C-minimal 



rewrite sequences, cf. 57]. Hence, we strive to extend this idea to complexity analysis. 



9.4.1 From Cycle Analysis to Path Detection 

Let us recall the definition of a dependency graph and extend it suitably to weak and 
weak innermost dependency pairs. 

Definition 9.4.1. Let ft be a TRS over a signature T and let V be the set of weak, weak 
innermost, or (standard) dependency pairs. The nodes of the weak dependency graph 
WDG(ft), weak innermost dependency graph WIDG(ft), or dependency graph DG(ft) are 
the elements of V and there is an arrow from s — > t to u — > v if and only if there 
exist a context C and substitutions a, r: V — > T(.F, V) such that to -^-* C[nr], where — > 
denotes or ±> n depending on whether V = \NDP(TZ), V = DP (ft) or V = WIDP(fc), 
respectively. 

Example 9.4.1 (continued from Example l9.3.ip . The weak dependency graph WDG(ft) 
has the following form. 

a a 

10^8 — >7 9 12 — ► 11 



We recall a theorem on the dependency graph refinement in conjunction with usable 
rules and innermost rewriting (see [57J , but also [70(] ) . Similar results hold in the context 
of full rewriting, see 



Theorem 9.4.1 ( 57]). A TRS ft is innermost terminating if for every maximal cycle C 
in the dependency graph DG(ft) there exists a reduction pair (>, >-) such that U(C) C > 
and C Q >-. 

The following example shows that we cannot directly employ Theorem 19.4.11 in the 
realm of complexity analysis. Even though in this setting we can restrict our attention 
to a specific strategy: innermost rewriting. 

Example 9.4.2. Consider the TRS ftexp 

exp(0) -» s(0) d(0) 

exp(r(x)) — » d(exp(x)) d(s(x)) — > s(s(d(x))) 
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DP(7£ e xp) consists of three pairs: 1: exp"(r(x)) — > d^(exp(x)), 2: exp"(r(:z;)) — > exp"(;c), 
and 3: d"(s(x)) — > d"(x). Hence the dependency graph DG(7£ exp ) contains two maximal 
cycles: {2} and {3}. It is easy to see how to define two reduction pairs (^.a, >.a) and 
>b) such that the conditions of the theorem are fulfilled. For that it suffices to define 
interpretations A and £>, respectively. Because one can find suitable linear restricted ones 
for A and B, compatibility with these interpretations apparently induces linear runtime 
complexity of 7Z e xp, cf. 2a, 74| (even for full rewriting). However, we must not conclude 



linear innermost runtime complexity for 7Z exp in this setting, as TZ exp formalises the 
exponentiation function and setting t n = exp(r™(0)) we obtain d\(t n , -^n) ^ 2 n for each 
n ^ 0. Thus the innermost runtime complexity of lZ exp is exponential. 

Note that the problem exemplified by Example 19.4.21 cannot be circumvented by re- 
placing the dependency graph employed in Theorem 19.4.11 with the weak (innermost) 
dependency graph. Furthermore, observe that while Proposition 19.3.11 allows us to re- 
place in Example 19.4.21 the innermost rewrite relation -^-ji by the (sometimes simpler) 
rewrite relation - L> t/(DP(7e))uDP(-R.)) this is of no help: The exponential length of t n in 
Example \MM with respect to U(DP(K)) U DP(K) is not due to the cycles {2} or {3}, 
but achieved through the non-cyclic pair 1 and its usable rules. These observations are 
cast into Definition 19.4.21 below. 

A graph is called strongly connected if any node is connected with every other node 
by a path. A strongly connected component (SCC for short) is a maximal strongly 
connected subgraph^ 

Definition 9.4.2. Let Q be a graph, let = denote the equivalence relation induced by 
SCCs, and let V be an SCC in Q. The set of all source nodes in Q /= is denoted by Src. 
Let I —f r be a dependency pair in Q, let /C € Q /= and let C denote the SCC represented 
by fC. Then we write l->rG/C if / ^r€C. 

Example 9.4.3 (Continued from Example EXT]). There are 6 (trivial) SCCs in WDG(fc),all 
being trivial. Hence the graph WDG(7£) /= has the following form: 

9 12 — > 11 



Here Src = {{9}, {10}, {12}}. 



9.4.2 Refinement Based on Path Detection 

We re-consider the motivating derivation D: 

to -^U(V)UV *1 ~^U(V)UV ' ' ' ^U(V)UV tn , (9.1) 

where to E To simplify the exposition, we set V = WDP(7£) and Q = \NDG(1Z). 
Momentarily we assume that all compound symbol are of arity 0, as is for instance 

6 Note that in the literature SCCs are sometimes defined as maximal cycles. This alternative definition 
is of limited use in our context as we must not ignore trivial SCCs. 
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the case in Example 19.3.11 Above we asserted that there exists an SLI A such that 
M(V) C >_4. Hence Proposition 19.3.21 is applicable. Thus, to estimate the length of the 
derivation (|9.ip it suffices to consider the following relative rewriting derivation: 

*0 ~^v/U(V) h -^V/U(V) ' " " —'V/UiV) tn • (9.2) 

Exploiting the given assumptions, it is not difficult to see that derivation (|9.2|) is repre- 
sentable as follows: 

where, ('Pi, . . . , V m ) is a pai/i in Q /= with "Pi G Src and l± ^ (i = 1, . . . , n). Since the 
length £ of the pictured ^-p/ W (-p)-rewrite sequence equals £% + • ■ -+£ m , this suggests that 
we can estimate each £j (j G {1, . . . ,m}) independently. We assume the existence of a 
family of SLIs Bj {j G {1, . . . , m}) such that U(Vi) U • • • U U(Vj) C and P,- C > Bj . 
holds for every j. From this we can conclude £j = 0(|t^. |) for all j G {1, . . . , m}. The 
next step is to estimate each £j by a function (preferable a polynomial) in |to|< As each 
of the WMAs Bj is assumed to be strongly linear, we can even conclude [«()]&, (^ ) = 
0(|i^. |). (Here «o denotes the assignment mapping any variable to 0.) In sum, we obtain 
for each j G {1, . . . ,m}, the existence of a constant Cj such that ^ Cj • \to\ and 
thus there exists a linear polynomial p(x) such that £j ^ p(|trj|)- However, some care 
is necessary in assessing this observation: Note that the given argument cannot be 
used to deduce polynomial runtime complexity, if we weaken the assumption that the 
algebras Bj are strongly linear only slightly. Hence, we replace the direct application of 
Proposition 19.3.21 as follows. 

Lemma 9.4.1. n < dl(s, -^/(SiuSa)) whenever s -> Sl * ■ -^n 2 /s 2 n u - 

Proof. Straightforward. □ 



We lift the assumption that all compound symbols are of arity at most 0. Perhaps 
surprisingly this generalisation complicates the matter considerably. First a maximal 
derivation need no longer be of the form given in (|9.3p which is exemplified by Exam- 
ple EXH below. 

Example 9.4.4. Consider the TRS K = {f(0) -> leaf , f(s(sc)) -» branch(f(x),f(x))}. 
The set WDP(7£) consists of the two weak dependency pairs: 1 : f"(0) — > C\ and 2 : f"(s(x)) 
C2(f"(x), f"(a?)). Hence the weak dependency graph WDG(7£) contains 2 SCCs: {2} and 
{1}. Clearly Src = {{2}}. Let t n = f»(s n (0)). Consider the following sequence: 

*2 ^{2} 2 C2(c2(to 5 io)jil) — C 2 (c2(ci,t )^l) 

^{2} C2(C2(Ci, to), C2(t , t(j)) ^{l} 3 C2 (C2 (Ci , Ci ) , C2 (ci , Ci )) . 

This derivation does not have the form (|9.3p . because it is based on the sequence 
({2}, {1}, {2}, {1}), which is not a path in WDG(ft)/=. 
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Note that the derivation in Example 19.4.41 can be reordered (without affecting its 
length) such that the derivation becomes based on a path. Still, not every derivation 
can be abstracted to a path. Consider a maximal (with respect to subset inclusion) 
component of WDG(7£)/=. Clearly this component forms a directed acyclic graph Q, 
and without loss of generality we assume in the following that Q is a tree T with root 
in Src. Otherwise, observe that any directed acyclic graph Q can be unfolded to a forest 
J- and that the size of Q is bounded in the size of T . Moreover if T G T is of maximal 
depth, then the size of T is linearly bounded in the size of T as the number of trees in 
J- depends only on 7Z. Suppose further that T is not degenerated to a branch. Then 
a given derivation may only be abstractable by different paths in T, as exemplified by 
Example 19.4.51 

Example 9.4.5. Consider the TRS 71 = {f -> c(g,h),g -> a,h -> a}. Thus WDP(ft) 
consists of three dependency pairs: 1: — > ci(g",h"), 2: g" —> C2, and 3: h" — > C3. 
Let V := WDP(ft), then clearly V = WDG(ft) = WDG(ft)/=. Consider the following 
derivation 

f -+p ci(g tt , h«) ci(c 2 ,h«) -+p ci(c 2 ,c 3 ) . 
This derivation is composed from the paths ({1}, {2}) and ({1}, {3}). 

Fortunately, we can circumvent these obstacles. Let V denote the set of weak or weak 
innermost dependency pairs of a TRS 7Z. We make the following easy observation. 

Lemma 9.4.2. Let Q denote a weak or weak innermost dependency graph. Let C Q Q 
and let D: s —^c/U(V) * denote a derivation based on C with s G Tq . Then D has the 
following form: s = s ~^c/U{V) s i -*C/U(V) • • • ~^C/U(V) $n=t where each Sj G 7^. 

Proof. It is easy to see that -D has the presented form and that for each i G {0, . . . , re} 
there exists a context C such that Si = C[u\, ...,«!•] and C consists of compound symbols 
only. This establishes the lemma. □ 

Motivated by Example 19.4.41 we observe that a weak (innermost) dependency pair 
containing an m-ary (m > 1) compound symbol can only induces m independent deriva- 
tions. Hence, we can reorder derivations to achieve the structure of derivation (|9.3p . 
This is formally proven via the next two lemmas. 

Lemma 9.4.3. Let Q denote a weak or weak innermost dependency graph and let K, and 
C denote two different nodes in Q /= such that there is no edge from K, to C. Let sq G Tc 
and suppose the existence of a derivation D of the following form: so ~^x./u(v) Sn ~*U{V) 
to ^c/uiv) Then there exists a derivation D' which has the form t' ~* r ^iuM}\ 

+1 >* J ,n „/ w Hln 4-1 ez T$ 

i m U(V) K,/U(V) b n wiLn L ^ 2 c ■ 

Proof. Consider the following two dependency pairs: 1: it? — * COM(dL, . . . , vt ) and 
2: u\ —> COM(uj 1} . . . ,u\ r ). Here the dependency pair 1 belongs to K, and denotes the 
last dependency pair employed in D before the path leaves /C into £, while 2 denotes the 
first pair in C. The assumption that there is no edge from K, to C can be reformulated 
as follows: 



128 



9.4 Dependency Graphs 



(f) No context C and no substitutions a, r : V — > T{J- ', V) exist such that 

cornea,..., v{ r a) -±* u{v) C[u\r\ , 

holds. 

To prove the lemma, we proceed by induction on n. It suffices to consider the step 
case n > 1. By assumption the last rewrite step in the subderivation Dq : sq ~^%/u(p) 
s n employs dependency pair 1. Let p G Vos(s n ) denote the position of the reduct 
COM(u|. 1 r, . . . , v\ r r) in s n . By assumption there exists a derivation s n ~^i[tp-\ to- Let 
q G Vos(s n ) denote the position of the redex in s n that is contracted as first step in this 
reduction. Without loss of generality we can assume that both positions are parallel to 
each other. Otherwise one of the following cases applies. Either p < q or p ^ q. But 
clearly the first case contradicts the assumption (f). Hence, assume the second. But this 
is also impossible. Lemma 19.4.21 yields that s n \ q £ which contradicts that q is redex 
with respect to U{V). Repeating this argument we see that position p has exactly one 
descendant in to- A similar argument shows that all redex positions in the subderivation 
D\ : to "^c/ucp) are parallel to (descendants of) p. Hence, we can move the last 
rewrite step s n _i — >k s n hi the derivation Dq after the derivation D\. Note that in each 
of the terms (ti)i=i,..., m the position p exists and denotes the term COM^jj^r, . . . ,v\ t). 
Hence, the replacement of COM(uLr, . . . , v\ r r) everywhere by u\a does not affect the 
validity of the rewrite sequence. Furthermore the set ^ is closed under this operation. 
Now, the induction hypothesis becomes applicable to derive the existence of the sought 
derivation D'. □ 

Let Q denote a weak or weak innermost dependency graph and let D : s — > t denote a 
derivation, such that s £ T b ". Here — ► denotes either —^'p/ucp) or ^v/UiV)- We say that 
D is based on (Vi, . . . , V m ) in Q /= if D is of the form 

(i) li W l m , 

b ~^V±IU{V) y V m /U{V) L ' 

with £x, . . . ,£ m ^ 0. We arrive at the main lemma of this section. 

Lemma 9.4.4. Let V denote a set of weak or weak innermost dependency pairs, let 
s 6 T b and let D : s t denote a maximal derivation, where — > denotes —*-p/u(p) or 
-^P/U{p) respectively. Suppose that D is based on (Vi, . . . ,V m ) and V\ G Src. Then 
there exists a derivation D' : s — >^ t based on (V[, . . . ,V m ,), with V[ G Src such that all 
V[ (i G {1, . . . , m'}) are pairwise distinct. 

Proof. Without loss of generality, we restrict our attention to weak dependency pairs. 
To prove the lemma, we consider a sequence (V\, ■ ■ ■ ,V m ), where there exist indices i, 
j and k with i < j < k and V% = Vk- By induction on j — % we show that this path is 
transformable into a sequence (V[, . . . , V' m ,) of the required form. It suffices to prove the 
step case. Moreover, we can assume without loss of generality that k = j + 1. Consider 
the two dependency pairs: 1: lj — * com(«|j, . . . , u!j- r ) and 2: i| — * GOM(u kl , u\ r ). 



129 



9 Complexity, Graphs, and the Dependency Pair Method 



Dependency pair 1 belongs to Vj and denotes the last dependency pair employed in D 
before the sequence leaves Vj into Vk, while 2 denotes the first pair in Vk- We consider 
two cases: 

(i) Assume there exist a context C and substitutions a, r : V — ► T{T, V) such that 
the following holds: COM (ul^er, . . . ,v^ r a) — >* C[Z^r]. Thus by definition of weak 
dependency graphs the node in WDG(7£) representing dependency pair 1 is con- 
nected to the node representing dependency pair 2. In particular every node in the 
SCCs represented by V% = Vk is connected to every node in the SCC represented 
by Vj. This implies that V% = Vj = Vk contradicting the assumption. 

(ii) Otherwise, there is no edge between Vj and Vk in the graph Q /= and by the assump- 
tions on (Vi, ■ ■ ■ ,Ve) we find a derivation of the following form: Do : Sj 1 -^ v v .ju(j>) 
Sj p ""^(73) s fci ~^v k /u(V) Sfc <3' ^ ue ^° Lemma 19.4.31 there exists a derivation 
D i : -*V k /U(V) s 'k q -*U{V) s 'h -*Vi/U{V) s j P so that the number of (weak) depen- 
dency pair steps is unchanged. The sequence {V\, . . . , Vj, Vk, ■ ■ ■ , V m ) is reorder- 
able into (Vi, . . . , Vk,Vj, . . . , V m ) without affecting the length t of the —^■p/ucp)- 
rewrite sequence. By assumption k = j + 1, hence the induction hypothesis be- 
comes applicable and we conclude the existence of a path (V[ , . . . , V' m , ) fulfilling 
the assertions of the lemma. 

□ 

Finally, we arrive at the main contribution of this paper. 

Theorem 9.4.2. Let TZ be a TRS, let V be the set of weak or weak innermost depen- 
dency pairs, let A denote the maximum arity of compound symbols and let K denote 
the number of SCCs in the weak (innermost) dependency graph Q. Suppose t G is 
(innermost) terminating and define 

L(t) := max{dl(i, —>-p m /s) I (Vi, ■ ■ ■ ,V m ) is a path in Q/= such that V\ € Src} , 

where S = Vi U • • • U V m -i UU(Vi U • • • U V m ). Then dl(t, ^v/U{V)) < K 2 ■ L(t). 

Proof. Let {V\, . . . , V m ) be a path in V /= such that V\ € Src and let D: t — ► u, denote 
a maximal derivation based on this path. (Here — ► denotes -^"p/UCP) or ^V/UCP)-) 
Lemma 19.4.41 yields that D has the following form: 

where to G 7T and tj € 7^ for all i ^ 1. It suffices to estimate £j for all j = 1, . . . ,m 
suitably. Let j be arbitrary, but fixed. Consider the subderivation D' of (|9.4p where m 
is replaced by j. Clearly D' is contained in the following derivation: 

t -^7» lU ...UP i _iUW(7'x)U-UW(7' i _i) ' ~^Vj/U(-Pi)U-\JU(Vj) 
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Hence Lemma [9A1] is applicable, thus £j ^ d\(t, —^■p j /-p 1 ]j-uVj-iiM(Ti)u—\Jll(Vj) 

). As 

U(V\) U • • • U U(Vj) C U(Vi U---UVj) we conclude £j ^ L(t) and obtain £ = i x + £ 2 + 

Above we argued that any connected component in V '/= is a tree. Clearly the number 
of nodes in this tree is less than K. Thus an arbitrary derivation can at most be based 
on if-many different paths. As the length of a derivation D based on a specific path can 
be estimated by K ■ L(t), we conclude that the length of an arbitrary derivation is less 
than K 2 ■ L(t). This completes the proof of the theorem. □ 

Theorem l9.4.2l together with Prop osition 19.3.21 form a suitable analog of Theorem l9.4.H 
Let V be the set of weak or weak innermost dependency pairs. Suppose for every 
path Wj := (Vn, . . . ,Vi m ) in V there exist an SLI Aj compatible with the usable rules 
of U, 

e{n,...,im} ^J" Assume t ne existence of a safe and G-collapsible reduction pairs 
SUch that W(Uj'g{i 1 ,...,i m } {ii,...,i m -i} * s com P a tible with >j and "Pj m 

compatible with such that V% m is non-duplicating. Then for any t € 7J, the derivation 
height dl(£, -^») with respect to (innermost) rewriting is majorised by G(t", >-$) and 

Corollary 9.4.1. Let 7?. be a TRS, let V be the set of weak (innermost) dependency 
pairs, and let Q denote the weak (innermost) dependency graph. Suppose for every 
path Wi = (Pa, ■ ■ ■ ,Vim) m Q /= there exist an SLI Ai and linear (quadratic) restricted 
interpretations Bj such that >B i ) forms a safe reduction pair with (i) U(Vn U • • • U 
Vim) C > A (ii) Vn U • • • U P im _i UWCPii U • • • U P im ) C (iii) P im C > Bim , and (iv) 
Pjrn is non-duplicating. Then the runtime complexity of a TRS 1Z is linear or quadratic, 
respectively. 

Proof. Observe that the assumptions imply that any basic term t € 7b is terminat- 
ing with respect to 1Z: Any infinite derivation with respect to TZ starting in t can be 



translated into an infinite derivation with respect to U(JZ) U V (see 7J, Lemma 16]). 
Moreover, as the number of paths in Q /= is finite, there exists a component Vj that rep- 
resents an infinite rewrite sequence. This is a contradiction. Without loss of generality, 
we assume V = WDP("P) and Q = WDG('P). Note that the reduction pair (^e i; >bJ is 
safe and collapsible. Hence for all i, the length of any — >-p jm /^-rewrite sequence is less 
than pj(|t|), where p m denotes a linear (or quadratic) polynomial, depending on \t\ only. 
(Here S = V%\ U • • • U V% m -\ UU(Vn U • • • U Vim)-) in analogy to the operator L, we de- 
fine M(t) := max{dl(t, — >-p im us) I (~Pn, ■ ■ ■ , Vim) is a path in Q /= such that V%\ € Src}. 
An application of Proposition 19.3.21 yields M(t) = 0(pi(\t\)). Following the pattern 
of the proof of the theorem, we establish the existence of a polynomial p such that 
dl(i, —t-puuCP)) ^ P(l*l) holds for any basic term t. Finally, the corollary follows by an 
application of Proposition I9.3.11 □ 

As mentioned above, in the dependency graph refinement for termination analysis it 
suffices to guarantee for each cycle C that there exist no C-minimal rewrite sequences. 
For that one only needs to find a reduction pair (•>,>-) such that TZ C >, C C > and 
C n y 7^ 0. Thus, considering Theorem l9.4.2l it is tempting to think that it should suffice 
to replace strongly connected components by cycles and the stronger conditions should 
apply. However this intuition is deceiving as shown by the next example. 



131 



9 Complexity, Graphs, and the Dependency Pair Method 



Example 9.4.6. Consider the TRS K of f(s(x),0) -> f(s,s(0)) and f(x,s(y)) -> f(x,y). 
WDP(ft) consists of 1: f*(s(z),0) -> f s (x,s(x)) and 2: f*(x,s(y)) -» f tt (z,?/), and the 
weak dependency graph WDG(7£) contains two cycles {1,2} and {2}. There are two 
linear restricted interpretations A and B such that {1,2} C U >a, {1} Q >A-> an d 
{2} C >g. Here, however, we must not conclude linear runtime complexity, because the 
runtime complexity of 1Z is at least quadratic. 



9.5 Conclusion 

In this section we provide (experimental) evidence on the applicability of the technique 
for complexity analysis established in this paper. We briefly consider the efficient imple- 
mentation of the techniques provided by Theorem 19.4.21 and Corollary 19.4.11 Firstly, in 
order to approximate (weak) dependency graphs, we adapted (innermost) dependency 
graph estimations using the functions TCAP (ICAP) [59]. Secondly, note thai a graph 
including n nodes may contain an exponential number of paths. However, to apply 
Corollary 19.4.11 it is sufficient to handle only paths in the following set. Note that if we 
can assume that Q /= is a tree, then this set contains at most n 2 paths. 

{("Pi, . . . , Vk) | (Vi, . . . , Vm) is a maximal path and k ^ m} , (9-5) 

Example 9.5.1. Consider the following non-total terminating 1Z. 

13: p(f(f(x))) -> q(f(g(x))) 15: p(g(g(x))) - q(g(f(x))) 
14: q(f(f(;r))) - p(f(g(x))) 16: q(g(g(x))) -+ p(g(f(x))) 

The weak dependency pairs WDP(7£) are given as follows: 

17: p«(f(f(x))) q«(f(g(x))) 19: p«(g(g(x))) -> q«(g(f(x))) 
18: q«(f(f(x))) -> p«(f(g(x))) 20: q«(g(g(x))) - P S (g(f(x))) 

Hence for WDG (?£)/= the set U23J) consists of 4 trivial paths: ({17}), ({18}), ({19}), 
and ({20}). Exemplarily we treat one of the trivial paths. 

- Consider 17: p B (f(f(x))) -> q tt (f(g(x))). Observe that U({17}) = 0. In order to 
orient this weak dependency pair it suffices to employ the following polynomial 
interpretation pjg(x) = 1 and qjg(x) = fg(x) = gs(x) = 0. 

In a similar fashion, we can treat the remaining three paths. It is not difficult to argue 
that this implies that the runtime complexity function of TZ is constant. Note that none 
of the other techniques in the analysis of runtime complexities can obtain this (optimal) 
bound. 

Moreover, to deal efficiently with polynomial interpretations, the issuing constraints 



are encoded in propositional logic in a similar spirit as in 5JJ]. Assignments are found 
by employing a state-of-the-art SAT solver, in our case MiniSatQ Furthermore, SLIs 



7 http : //minisat . se/ 
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Table 9.1: Results for Linear Runtime Complexities 



full rewriting innermost rewriting 

direct PropEM] Prop l9X3l Cor l9XT1 Prop ITOI PropESJ Cor l9XT1 



139 


139 


93 


108 


144 


102 


117 






(147) 


(162) 




(166) 


(181) 


7 


9 


U 


6 


8 


16 


6 


1591 


1582 


1646 


1630 


1577 


1637 


1619 


2474 


4789 


456 


607 


4699 


462 


536 


8 


17 





1 


17 





3 



are handled by linear programming. Based on these ideas we implemented a complexity 
analyser. These techniques have also been incorportated into the Tyrolean Complexity 
Tool (T(T for short) that incorporates the most powerful techniques to analyse the 
complexity of rewrite systems that are currently at handle For compilation of the here 
presented experimental data we used the latter implementation. 

As suitable test bed we used the rewrite systems in the Termination Problem Data 
Base version 4.00 This test bed comprises 1739 TRSs. The presented tests were per- 
formed on a server with 8 Dual-Core 2.6 GHz AMD® Opteron™ Processor 8220 CPUs, 
for a total of 16 cores. 64 GB of RAM are available. For each system we used a timeout 
of 60 seconds, the times in the tables are given in seconds. In interpreting defined and 
dependency pair symbols, we restrict to polynomials whose coefficients are in the range 
{0,1,..., 5}. Table 19.11 (|9.2p shows the experimental results for linear (quadratic) run- 
time complexities based on linear (quadratic) restricted interpretations Text written 
in italics below the number of successes or failures indicates the total time (in seconds) 
of success cases or failure cases, respectively. The columns marked "Prop. 19.3.31 ' and 
"Cor. l9~4TlT refer to the applicability of the respective results. Moreover "S", "F", "T" 
denotes success, failure, or timeout respectively. For the sake of comparison, in the 
parentheses we indicate the number of successes by the method of the column or by 
Proposition 19.3.11 

In concluding, we observe that the experimental data shows that the here introduced 
dependency graph refinement for complexity analysis extends the analytic power of the 
methods introduced in [74| (see also Chapter [8]). Note the significant difference between 
those TRSs that can be handled by Propositions 19. 3!T1 and [9~.3.3I in contrast to those that 
can be handled either by Proposition 19.3.11 or by Corollary I9.4.H Moreover observe the 
gain in power in relation to direct methods, compare also 2a. 111]. 



i http : // cl-inf ormatik. uibk. ac . at/ sof tware/t ct/ 
' See http : / /t ermc omp . uibk . ac . at 

'For full experimental evidence see http://www.jaist.ac.jp/~hirokawa/08b/ or 
http : // cl-inf ormatik. uibk . ac . at/ sof tware/t ct/ 
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Table 9.2: Results for Quadratic Runtime Complexities 



full rewriting innermost rewriting 

direct PropEM] Prop l9"X31 Cor l9XT1 Prop l9TO PropESJ Cor l9XT1 



182 


182 


93 


108 


183 


102 


117 






(186) 


(202) 




(193) 


(208) 


152 


329 


97 


74 


324 


98 


54 


524 


473 


1636 


1624 


492 


1627 


1613 


5469 


5436 


793 


850 


5500 


825 


781 


864 


951 


10 


7 


924 


10 


9 
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